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Thrs was a field study involving two groups of airline 
pilots over a two-year period to determine what factors affected 
their transition from traditional airline cockpits to a highly 
automated version. All were nighly experienced in traditional 
models of the McDonnell-Douglas DC-9 (-10, -30 and -50 models) 
prior to their transition to the more automated DC-9-30 (MD-80) . 

Results and conclusions dealt with specific features of the 
new aircraft, particularly the digital flight guidance system 
(DFGS) and other automatic features such as the autothrottle 
system (ATS), autobrake, and digital displays. Particular 
attention was paid to the first 200 hours of line flying 
experience in the new aircraft, and the difficulties that some 
pilots found in adapting to the new systems during this initial 
operating period. The lack of a DC-9-80 simulator at the 
beginning of the study, and its subsequent availability to pilots 
who transitioned later in the study was a salient fea'ure of the 
project. Other findings involved efforts to prevent skill loss 
from automation, training methods, traditional human factors 
issues, and general views of the pilots toward cockpit automation. 
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SUMMARY 


This was a field study involving two groups of airline 
pilots over a two-yetr period to determine what factors affected 
their transition from traditional airline cockpits to a highly 
automated version. All were highly experienced in traditional 
models of the McDonnell-Douglas DC-9 (-10, -30 and -50 models) 
prior to their transition to the more automated DC-9-S0 (MD-80) . 

Results and conclusions dealt with specific features of the 
new aircraft, particularly the digital flight guidance system 
(DFCS) and other automatic features such as the autothrottle 
system (ATS), autobrake, and digital displays. Particular 
attention was paid to the first 200 hours of line flying 
experience in the new aircraft, and the difficulties that some 
pilots found in adapting to the new systems during this initial 
operating period. The lack of a DC-9-80 simulator at the 
beginning of the study, and its subsequent availability to pilots 
who transitioned later in the study was a salient feature of the 
project. Other findings involved efforts to prevent skill loss 
from automation, training methods, traditional human factors 
issues, and general views of the pilots toward cockpit automation. 
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I . INTRODUCTION 

The microprocessor revolution of the 1970's offered 
commercial aircraft and avionics manufacturers the opportunity to 
design and lmpiement small, special purpose digital computers for 
the f lightdeck. These computers made it possible to automate 
many of the functions previously performed manually by the 
flightcrew, and as well to provide the logic for warning and 
alerting systems that, in effect, worked in parallel with the 
pilot. In addition, flight instruments driven by digital 
computers allowed the designer to display digitally information 
which previously had been present analogically, mostly on 
pointer-type instruments. 

Thus, the new generation of automated, microprocessor-based 
transport aircraft went far beyond previous generation of 
automatic equipment, such as autopilots, flight directors, and 

®l®rters. The potential has only begun to be exploited. 
For example, the potential fuel savings of 4—D navigation and 
microwave landing systems (MLS) is now being addressed, partly 
because the airborne equipment has not yet been perfected, but 
mainly because the ATC system does not yet allov full 
exploitation of flight-deck automation. 

By the end of the 1970's, many in the aviation field, and in 
government, were beginning to be concerned about certain safety 
implications of the march toward automation. There was evidence 
from aviation accidents and incidents, as well as words of 
caution from members of the human factors profession (Edwards, 
1977), that human error could not be automated out of the system, 
and indeed, design and installation of automatic devices in the 
cockpit, without proper human factors principles, could increase 
rather than decrease, the potential for human error. Questions 
were also being raised about whether automation would necessarily 
reduce crew workload. 

In 1977 a House of Representatives subcommittee gathered 
opinions from various segments of the aviation industry on their 
areas of concern for commercial flight safety (Anon, 1977). One 
of the areas that stood out was automation. These concerns were 
voiced again in a Senate subcommittee (Anon, 1980). As a resul . 
of these hearings, and other concerns about the safety impact o r 
automation, in 1979 NASA was directed to examine the human 
factors of automation. An automation group was formed at tne 
NASA-Ames Research Center, under the direction of Dr. Renwick 
Curry. Dr. Curry and t u e author, then on leave from the 
University of Miami, published a paper (Wiener and Curry, 1980 ) 
in which they outlined the benefits and potential problems of 
automation on the flightdeck, and drafted 15 tentative principles 
(previously called "guidelines"), which are reprinted in ADpendix 
1 of this report. 

In order to seek further information and opinion on tne 
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potential human factors problems of automation, NASA held a joint 
industry-NASA workshop on flightdeck automation in the summer of 
1980. A small group of experts from industry, government, 
airlines, academic institutions, and NASA examined the issues and 
drafted a report which generated questions that would require 
research in the years to come (Boehm-Davis, Curry, Wiener, and 
Harrison, 1981). 

In this report, no effort has been made to provide a 
comprehensive review of the literature and state-of-the-art of 
cockpit automation. This can be found in the papers by Wiener 
and Curry (1980) and Wiener (1985). 

Purpose of the Research 

The purpose of this research was to gain information on the 
human factors of automated cockpits. The particular issue under 
study was the transition of pilots from a traditional technology 
aircraft (DC-9-10, -30 and -50) to a highly automated derivative 
model. The DC-9- 80 is used here as a "laboratory" to study crew 
transition. The study is not intended as a critique of the DC-9- 
80 design per se. However, in collecting questionnaire and 
interview data, it was inevitable that the crews would discuss in 
minute detail the particular systems of this aircraft. It is 
impossible to conduct an "aircraft independent" project of this 
sort. The author feels that most of the comments regarding DC- 9- 
80 systems can be interpreted as generic statements regarding 
flightdeck automation. 

Also, the results of this study may not be entirely "airline 
independent", as they are the product of one airline's experience 
in adapting to a new technology aircraft. It is inevitable that 
there will be problems as well as successes in integrating a new 
aircraft, particularly one employing a new technology, into an 
airline's fleet. The problems, as reflected in some of the 
negative comments made during interviews (see Section VI), should 
not be construed as criticism of either the host airline or tne 
manufacturer. Two points should be made regarding some of the 
comments in the interview section: 

1) Most of the training problems mentioned by the check 
airmen and line pilots were the consequence of not 
having a DC-9- 80 simulator availab)e. This was remedied 
later in the study period, and a much more positive view 
of both the training and the aircraft emerged in the 
second phase of data collection as a result of this. 

2) As the pilots became more experienced in the -80, most 
of the negative sentiments vanished. 






II. BACKGROUND TO PRESENT STUDY 


Ihs Choice uf the Super J10 

NASA scientists felt that many of the questions posed by 
the workshop could best be answered by field investigations with 
air carriers, rather than laboratory work. In 1980 the 
introduction of the McDonnell-Douglas DC-9- 80 (Super 80) 
presented a golden opportunity for such a field investigation. 

(In 1983 Douglas redesignated the aircraft the HD-80. For 
the sake of consistency, this report will use the traditional 
designation). The Super 80 was designed for the short and medium 
haul market, and would bring to the carriers serving these 
markets an aircraft with electronic and avionic sophistication 
previously seen only a widebody transports. The intended market, 
consisting mainly of regional carriers, made the -80 especially 
attractive as a study vehicle, since it would be flown primarily 
by flight crews transitioning from older, less automated aircraft 
such as Boeing 737s and 727s, and older models of the DC-9. For 
this reason we would have the opportunity to study the reactions 
of pilots who were flying sophisticated avionics for the first 
time (excluding possibly military experience). This was in 
contrast with the larger trunk carriers, where many flightcrew 
members, especially very senior first officers and very junior 
captains, might have had right-seat experience in sophisticated 
widebody aircraft. 

At a meeting of the Operations Forum of the Air Transport 
Association (ATA) in 1980, Dr. Alan Chambers revealed the desire 
of his division to work with a carrier planning to buy the DC-9- 
80. Capt. John Hanson, then Director of Flight Standards and 
Training at Republic Airlines, expressed an interest, and shortly 
after Curry and Wiener made a formal proposal for a cooperative 
study to Republic's flight operations management and the 
Republ ic/ALPA Safety Committee. In April 1981 the author 
attended a three-week pilot training course on the Super 80 at 
Douglas Aircraft in Long Beach, and the work with Republic began 
in early 1982. 


The £up££ -flfl Design Philosophy 

In order to understand the great value of the Super 80 for 
this study, it is necessary to discuss briefly the design 
philosophy of the plane, and its place in the crew complement 
("two vs. three man") issue. With the introduction of digital 
systems into the cockpit, the question of crew workload, and 
hence crew size, was emerging as an issue between manufacturers, 
c r carriers, and pilot unions in the U.S. and worldwide. Both 
a ame and avionics manufacturers were stressing the promise of 
au iation in achieving workload reduction, and it became clear 
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that their intention was to request certification for aircraft 
with two-pilot crews. An article on the Super 80 avionic system 
appearing in Aviation Week And Space Technology (Smith, 1978) 
well before the appearance of the Super 80, was entitled, 

"Digital system used to cut workload." Douglas, as well as 
Sperry, the designer of the digital flight guidance system 
(DFGS) , based their design philosophy on workload reduction 
through automation. This was due to concern for the safety of 
aircraft operated by regional carriers, which by the nature of 
their operations, typically spent a large portion of each leg in 
climb and descent in high-density terminal areas. The collision 
of a PSA Boeing 727 with a Cessna 172 over San Diego in 1978 
intensified the desire to reduce cockpit workload, allowing more 
time for extra-cockpit scanning. But clearly the manufacturers 
and potential customers also sought to head off any argument that 
the Super 80 should carry a third pilot, the position adopted by 
the Air Line Pilots Association (ALPA) , though not all of its 
individual executive councils. The purpose in mentioning this is 
to stress the emphasis on workload reduction in the design phase. 
A more thorough discussion of workload and the crew complement 
question can be found in Wiener (1985) . 

The issue was eventually settled by the President's Task 
Force on Crew Complement (McLucus et al., 1981) and the FAA's 
certification of the -80 as a two-pilot aircraft. The 
Presidential Task Force based its decision largely on the 
demonstrated safety record of two-pilot aircraft, and the 
assumption that workload was not likely to increase in future 
models. The assumption that the flightcrew's workload is reduced 
in any aircraft by introducing automation was challenged by 
Wiener and Curry's report (1980), in which they argue that 
workload may not be reduced at all, but merely relocated in time 
(for example, programming at the gate, rather than in flight). 
Likewise, the nature of the workload may be changed, as for 
example, reducing manual operations, but increasing the need to 
monitor the equipment. This viewpoint was expressed recently by 
the National Transportation Safety Board in its recommendations 
following a DC-10 overshoot accident at Kennedy Airport (NTSB , 
1984). The author begins with the positio.. that it should never 
be assumed the automation reduces total workload. This is one of 
the primary questions to be addressed by the present study. 
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III. STUDY METHODOLOGY 


Data Sources 

Since this study focussed on the adaptation of flightcrews 
to the more highly automated environment of the -80, most of the 
data were collected directly from crew members — including line 
crews and check captains* The following sources of data were 
originally proposed: 

a. cockpit observations 

b. structured interviews with crews 

c. questionnaires filled out by crews 

d. interviews with check captains 

e. interviews with simulator instructors 

i.'. maintenance logs 

g. check pilot meetings 

Of these proposed sources of information, only the first 
four were examined extensively, for the following reasons. Since 
Republic's -80 simulator was not installed until May 1983, 
interviews with simulator instructors were not pursued. 
Maintenance logs did not prove to be a valuable source of 
information. A sample maintenance log (ATA Chapter 22 items) of 
one aircraft (No. 301) was examined and was deemed not to have 
potential for this study. Minutes of check pilot meetings were 
useful principally for formulating questions to be asked in 
interviews with check captains. 

Longitudinal Analysis 

Early in the project it was decided to design what is known 
as a "longitudinal analysis." This study method involves forming 
a study group, usually referred to as a "panel,” and collecting 
data from them over several points in time. The value of a 
longitudinal study is that it permits the investigation of 
changes within individuals, rather than comparing groups of 
different individuals at points in time (called a "cross- 
sectional analysis"). In this research, intra-individual 
differences seemed important — we were interested in how one's 
approach to and adaptation to cockpit automation changed over 
experience (and hence time). By starting early, we would be able 
to collect our first sample of data (called a "wave" in 
longitudinal analysis) early in the pilot's experience with the - 
60. 


The disadvantages of a longitudinal analysis should also be 
mentioned. Longitudinal studies tend to be expensive; they 
require a panel who will remain with the study through its 
several waves; and in spite of dedication, some panel members are 
inevitably lost over the length of the study for a variety of 
reasons, inducing illness, retirement, or reassignment. In 
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addition, there are inevitable gaps in the data, due to some 
panel members, for one reason or another, failing to fill out 
questionnaires or not being available for interview, yet 
remaining in the panel for future waves. Also, continuing 
support from the host organizations is mandatory. And finally 
longitudinal methods require a continuity of the investigative 
staff, especially when field observations and face-to-face 
interviews are required, and hence standardization is essential. 

Panel Formation 

Pilot volunteers were contacted by a direct mailing from 
the Republic Central Air Safety Committee of the Air Line Pilots 
Association (AI-PA) , which acted as a go-between, linking the 
pilots with the investigators throughout the study. A booklet 
explaining the purpose of the study and carrying a cover letter 
bearing the endorsement of the management and the union, went out 
to the original group of pilots (approximately 100) who had 
received -80 training. Unfortunately, due to post-Deregulation 
economic conditions, the company drastically cut its order of - 
80s, receiving only three initially in 1981, and three more in 
December 1982. Consequently, many of the original trainees had 
not flown the line in the -80 at the time of the first appeal for 
volunteers, and many of the remaining trainees flew only a 
minimal number of trips in the -80. Thus the original appeal 
yielded only 30 volunteers, and some of these never flew the -80 
in line operations. 

In the summer of 1982, and later in December of i?82 and 
January 1983, more pilots entered differences training, ar.d eignt 
of these joined the panel, but not in time for the first wave of 
questionnaires, which went out in June 1982. Those who joined 
subsequent to that time received their first series of 
questionnaires at the same time that the original panel received 
their second, in June 1983. The mean flying time in the -80 of 
those responding to the first wave was 365 hours, with a mean 
total flying time of over 15,000 hours. The standard deviation 
of -80 time was 290 hours, indicating a great variation around 
the mean. The minimum was 37 hours, and the maximum was 1 1 B0 
hours. Thus it can be seen that the mean experience level in the 
-80 was the equivalent of less than one-half year of full time 
line flying. See Table 2-B for the Wave Two flying time data. 

In 1983 Republic decided to move approximately half of its 
Super 80 blocks to the Las Vegas domicile. This further reduced 
the number of Minneapolis pilots in the study panel who were 
actively flying the -80, but created an opportunity to form a new 
panel. With the approval and assistance of Republic's western 
Safety Committee, a panel of 13 volunteers based in Las Vegas was 
formed in the fall of 1983, and soon after first wave 
questionnaires were mailed out. Since Republic's simulator war 
not installed until May 1983, the first Las Vegas crews went 
through the differences program (training program for already 
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qualified DC-9 crews, stressing only the different or new 
features of the DC-9-80), but shortly after this the new Las 
Vegas crews went through the simulator-based program. Thus the 
Las Vegas study panel was composed of crews from both training 
programs. The role of the simulator in early line experience is 
discussed at length in this report. 

Confidentiality 

Confidentiality was ensured by having each pilot assign 
himself an eight letter/digit code when he initially joined tne 
panel. Those codes were placed on all questionnaires by the 
respondents, but only the union Safety Committee had the code-to- 
name legend, and it was never seen by the author. It has since 
been destroyed. In the face-to-face interviews, the author knew 
the name of the pilot he was interviewing (it would be 
impractical to do otherwise) , but did not know his code ID, and 
did not record his name on the interview form. In jumpseat 
observations, no record was kept of flight numbers, dates, or 
crew members' names. 

Questionnaire Development 

Three areas to be probed in soliciting aircrew opinions and 
practices were determined from the following sources: initial 

interviews with management pilots, jumpseat observations in older 
models of the DC- 9, jumpseat oDservations in -80‘s of another 
carrier, and conversations with the crews, the experiences gained 
in attending the DC- 9- 80 school in Long Beach, and the questions 
generated at the NASA Industry Workshop. The tore* areas were: 

1) attitudes toward automation in general, and the DC-9-80 
cockpit in particular; 2) frequency of use of those automatic 
devices whose use was a matter of pilot option; and 3) pilot 
perception of workload and fatigue. 

Numerous forms for the attitude scales were considered. 
Knowing pilots' disdain for paperwork, and mindful of our promise 
in the invitation to join the panel that participation would 
require only four to five hours a year, we sought to design forms 
that would be simple in format and would not require over one 
hour to complete. The final forms consisted of two instruments, 
a 35-item Likert-type attitude scale, and a 5-by-16 matrix 
frequency of use cnart (sec Figures 1 and 2). The Likert scale 
is an intensity type of attitude measurement, in which a 
statement is presented, and :he respondent replies along a 
continuous scale from strong disagreement to strong agreement 
with the statement. The statements can be positive or negative 
toward the subject at hand- The advantages of the Likert scale 
is that it is easy for the respondent, allows a wide range of 
response (some forms use a multiple-choice restricted response), 
and is easy to score. The statements themselves were designed to 
probe several general (though somewhat overlapping) arp.is: 
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1. General attitude toward automation 

2. General attitude toward flying as a profession 

3. Specific attitude toward certain features of the -80, 

and specific items 

4 . General attitudes toward the influence of equipment on 

safety and economy 

5. Influence of automation on workload, fatigue, and time 

to perform tasks, including extra-cockpit scanning 

The 36 items are listed in Table 1. The f requency-of-use 
scale simply asks the crew member to indicate the frequency, in 
terms cf percentages, of his use of 16 pieces of equipment. 
Frequency of use was considered crucial to the study for several 
reasons. First, the NASA-Industry Workshop participants had 
raised several questions regarding possible overuse and underuse 
of automatic options (Boehm-Davis, et al., 1981). Secondly, 
frequency of use is a variable that may show considerable change 
in a longitudinal study. We expected frequency of use of 
automatic features to increase over time, particularly between 
the first and second wave of data collection. Finally, it is the 
general policy of Republic management that automatic devices 
should be used (subject to captain's discretion, of course). 
Pilots referred to this policy as "we bought it, you use it", and 
this is discussed in later sections. Since the Republic -80 
pilots all had considerable experience with earlier models of the 
DC-9, this scale, with this panel provided a particularly good 
opportunity to determine patterns of usage of equipment that they 
were encountering for the first time. There were problems in the 
interpretation of the instructions, which led to some 
questionable data on this form. This is discussed in Section IV. 

Interviews 

A structured interview form was developed for use with the 
line pilots, and was tested in interviews with management pilots. 
A structured interview is a compromise between a questionnaire 
(completely structured) and a totally unstructured interview. It 
imposes structure to the extent of making certain that all topics 
are covered, but allows the freedom of an unstructured interview 
to follow up points, seek clarification, and in general use 
interviewer judgement about pursuing points further, or ending 
discussion if need be. In the interviews with the panel, many 
valuable points were raised by the interviewees that would n^t 
have been revealed in a questionnaire or rigid interview. 

The interviews with the chec . captains covered all of the 
points covered in the line pilot interviews, but also included 
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Table 1 


The 36 Likert scale items 

1. Flying today is more challenging than ever. 

2. I miss the "good old days" of simpler aircraft. 

3. I am concerned about a possible loss of my flying skills 
with too much automation. 

4. I hand fly part of every trip to keep my skills up. 

5. Hand flying is the part of the trip I enjoy the irost. 

6. I think they've gone too far with automation. 

7. I can fly the airplane as smoothly and safely by hand as 
with automation. 

8. It is important to- me to fly the most modern plane in the 
company's fleet. 

9. I look favorably on automation in the cockpit - the more the 
better . 

10. I am looking forward to even more automation in future 
planes. 

11. I wish we had full autothrottles on the 10s, 30s and 50s. 

12. Younger pilots catch on to automation faster than older 
ones. 

13. Pilots who overuse automation wii see their flying skills 
suffer . 

14. Automation frees me of much of the routine, mechanical parts 
of flying so I can concentrate more on "managing" the 
flight. 

15. I spend more time setting up and managing the automatics 
(such as the DFGS) than I would hand flying or using the 
old style autopilots. 

16. Older pilots seem to resist the new technologies. 

17. Automation does not reduce workload, since there is more to 
keep watch over. 

18. Automation is the thing that is going to turn this industry 
around and make it profitable again. 
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19. Automation may be helpful in long-haul operations, but not 
in short-segment operations like ours. 

20. All these new features are nice to have, but they 1 re not 
worth the money. 

2i * useful dUt ° matiC devices a iot 3 ust because I find them 

22. Autoland capability woulu definitely enhance safety. 

23. I use automatic devices mainly because the company wants me 
to* 

24. Cat II and Cat III operations would mean very little to our 

company. wut * 

25. I have serious concerns about the reliability of this new 
equipment. 

26. I am worried about sudden failures of the new diqital 
devices like the DFGS and the ARTS. 

27. Automation reduces overall workload. I 

\ 

28. The new equipment is more reliable than the old. ! 

29. Too much automation can be dangerous. I 

30. Overall, automation reduces pilot fatigue. 

31. I think that the -80 is a significant step forward in short 
and medium haul aircraft# 

32. The -80 is just another DC-9 with some new toys. 

33. The ARTS feature of the -80 is a real plus for safety on 

takeoff. 1 

34. Flying the -80 is definitely easier than flyinq the older 
models. 

35. I enjoy flying the -80 more than the older DC-9s. 

36. I like to use the new features of the -80 as much as 
possible. 
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questions regarding their experiences as instructor pilots on the 
-80. Of particular interest were questions dealing with their 
perceptions of problems encountered by students during training, 
and during their Initial Operating Experience (IOE) on the line. 

It turned out that the interviews were even less structured 
than the author intended. He quickly discovered that it was 
difficult to keep the pilots from jumping from one subject to 
another. So the order of' the questions were abandoned, and the 
only structure imposed was to make certain that all topics were 
covered, regardless of order. It is probably safe to say that 
the inability of the interviewer to keep the discussions running 
in a structured order could be taken as a measure of the 
enthusiasm that the pilots had for the project. Most came in 
showing advanced preparation for the interview, with an "agenda < 

of things they wanted to say about the automatic features and the 
cockpit design. Some arrived with a written list of items that 
they wished to cover, and several times, pilots who were not part 
of the study panel arrived and asked to be interviewed. 


Data Handling 

The Likert scales were scored by constructing a ruler which 
measured the position of the "X" mark in terms of its distance 
from the leftmost (strongest disagreement) point on the scale. 

The position of the "X" was scored from 01 (strongest 
disagreement) to 99 (strongest agreement). Scores close to 50 
indicate mid-scale ("neither agree nor disagree") responses. 

Thus, for each pilot, there were 36 Likert scale scores ranging 
from 01 to 99, and on the same form, three questions regarding 
flying experience* total flying time, total time in the —80, and 
the number of days (at the time of filling out the forms) since 
last flying the -80. The results are summarized in Tables 2-A 
and 2-B in the next section. 

The percent-use scale data was recorded in terms of 
percentages, from 0 to 100. Pilots were instructed to place an 
"X" in any cell where the equipment was not usable or its use 
invalid (e.g. autobrake at cruise), to distinguish that condition 
from legitimate responses of zero use. Questionnaires were 
returned by mail. 

The data were entered by keyboard into an Apple II 
computer, using a commercially available database management 
package, DB Master, which created a file for each questionnaire 
form. Foe statistical analysis, the data were ported via 
telephone modem from the database in the Apple to the University 
of Miami's Univac 1108 mainframe. A more detailed writeup of the 
data management system can be found in Appendix 2. 
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Figure 1 

DC- 9- 80 attitude questionnaire 


1. Flying today is more challenging than ever. 


1 

Strongly 

Disagree 

Disagree 


— 1 

Neither 
agree nor 
disagree 


Agree 

1 

Strongly 

Agree 

2. I miss the "good old 

days 

" of simpler 

aircraft. 
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of my flying skills with 
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Neither 
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Agree 

Strongly 
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4. I hand fly part of every 
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Strongly 
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5. Hand 

flying is the part of the trip that 
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most . 
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Strongly 
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too 

far with automation. 
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Strongly 
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IV. QUESTIONNAIRE RESULTS 


Likert Attitude Scales 

The Likert attitude scale statistics are summarized in 
Tables 2-A and 2-B. The samples sizes were 37 in Wave One and 20 
in Wave Two, on some scales the samples sizes were less, due to 
missing data in the questionnaire forms. Appendix 4-A and 4-B 
contain in computer printout form the entire intercorrelation 
matrix for the 36 attitude items and the three flying time items 
(total of 39 points per pilot). 

Since 36 attitude scales are more than a reader can digest, 
we have sorted the items by content into groupings, which are 
listed in Table 3 and displayed in Figures 3-A through 3-F. Note 
that this grouping was based on subjective judgements on the part 
of the author — it does not represent the results of statistical 
clustering techniques such as factor analysis. There were too 
few data to use such methods, as they require that there be more 
respondents than items. The six groupings, subjective as they 
may be, make it easier to read and discuss the data. Figures 1-A 
through 1-F depict in graphic form the mean of the responses to 
the attitude questions plus and minus one standard deviation . 

The striking feature of these data is the great diversity in 
attitudes, as seen both by the large standard deviations (about 
15 to 20 points in most cases) as well as the ranges. On most 
items the range of opinions run full-scale — from total 
disagreement (01) to total agreement (99). It is not usual for 
pilots to have diverse opinions about their jobs and equipment, 
but the magnitude of disagreement was somewhat larger than 
expected. Extremes of opinion will appear again in the face-to- 
face interviews to discussed in the next two sections. 


Frequency-of-Use 

The data from the f requency-of-use form are summarized in 
Table 4-A and 4-B. Note that the sample size varies considerably 
throughout the -80 cells in this table, due to the fact that it 
was up to the respondent to decide whether or not the equipment 
feature was appropriate for the phases of flight. 


Open-ended Questions 

Five open-ended questions were included at the beginning of 
the questionnaire package. Responses to these are summarized in 
Tables 5-1 to 5-5. 


rnmmfrnfg 


Respondents were encouraged to write in any comments they 
wished to make, not necessarily in response to any particular 
question, and several did so. These are summarized in Table 6. 







Table 2-A 


Summary statistics on flying experience data and attitude 
scale responses. Refer to Table 1 for full text of 
Likert statements. 


WAVE ONE 


Item 

N 

Mean 

S D • 

Min 

Max 

total time 

37 

15,2-4 

7 901 

4415 

30, 850 

time in -80 

37 

365 

2 90 

37 

1,180 

days since -80 fit 

36 

11 

19 

0 

90 

1. challenging 

37 

62 

26 

1 

99 

2. good old days 

37 

37 

20 

1 

80 

3. loss of skills 

37 

53 

27 

1 

99 

4 . hand fly 

37 

53 

27 

1 

99 

5. enjoy hand fly 

37 

58 

15 

25 

99 

6. too far w/ auto 

37 

34 

23 

1 

80 

7. hand vs. auto 

37 

49 

27 

1 

99 

8. mod important 

37 

56 

24 

1 

99 

9. more automation 

37 

54 

25 

1 

99 

10. future auto 

37 

58 

22 

25 

99 

11. autothrottles 

37 

62 

25 

1 

99 

12. young vs. old 

36 

58 

27 

5 

99 

13. overuse of auto 

37 

59 

23 

1 

99 

14. manage flight 

37 

70 

21 

20 

99 

15. time problems 

36 

43 

23 

1 

99 

16. old resist 

36 

53 

21 

1 

99 

17. more to watch 

36 

38 

24 

1 

99 

18. auto profit 

36 

37 

25 

1 

99 

19. auto not help 

36 

36 

22 

1 

99 

20. not worth $ 

36 

48 

25 

1 

99 

21. auto is useful 

36 

68 

17 

25 

99 

22. autoland 

37 

48 

23 

1 

99 

23. company wants 

37 

43 

22 

1 

95 

24. cat II & III 

37 

47 

27 

1 

99 

25. reliability 

37 

45 

25 

1 

99 

26. sudden failures 

37 

47 

28 

l 

99 

27. less workload 

37 

66 

23 

1 

99 

28. new * reliable 

37 

61 

25 

1 

99 

29. too much auto 

37 

54 

28 

5 

99 

30. reduce fatigue 

37 

67 

19 

25 

99 

31. -80 ■ progress 

37 

80 

13 

50 

99 

32. -80 new toys 

37 

33 

21 

1 

85 

33. ARTS * safety 

37 

71 

17 

25 

99 

34. -80 easier 

37 

60 

22 

1 

99 

35. I enjoy -80 

37 

77 

21 

25 

99 

36. use features 

37 

70 

1 8 

25 

99 
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Table 2-B 


WAVE TWO 


Item 

N 

Mean 

S.D. 

Min 

Max 

total time 

20 

13, 891 

8031 

4500 

28, 000 

time in -80 

20 

674 

310 

100 

1,350 

days since -80 fit 

20 

12 

15 

0 

45 

1. challenging 

20 

62 

23 

1 

99 

2. good old days 

20 

40 

19 

1 

75 

3. loss of skills 

20 

55 

28 

1 

91 

4. hand fly 

20 

60 

26 

12 

99 

5. enjoy hand fly 

20 

53 

18 

12 

87 

6. too far w/ auto 

20 

46 

22 

1 

75 

7. hand vs. auto 

20 

42 

22 

1 

83 

8. mod important 

20 

47 

23 

1 

85 

9. more automation 

20 

57 

19 

25 

88 

10. future autc 

20 

56 

21 

25 

87 

11. autothrottles 

20 

52 

24 

12 

99 

12. ycung vs. old 

20 

62 

19 

1 

90 

13. overuse of auto 

20 

60 

22 

25 

99 

14. manage flight 

20 

68 

20 

25 

99 

15. cime problems 

20 

39 

18 

1 

75 

16. old resist 

20 

54 

21 

10 

86 

17. mere fn watch 

20 

44 

24 

1 

75 

18. auto orofit 

20 

43 

24 

1 

88 

19. auto not help 

20 

36 

14 

10 

60 

20. not worth $ 

20 

44 

22 

1 

99 

21. auto is useful 

19 

69 

17 

30 

99 

22. autoland 

19 

49 

17 

10 

75 

23. company wants 

20 

49 

21 

25 

75 

24. cat 11 & III 

20 

42 

19 

25 

85 

25. reliability 

20 

40 

21 

5 

75 

26. sudden failures 

20 

44 

23 

5 

75 

27. less workload 

20 

70 

13 

40 

90 

2 8. new * reliable 

20 

60 

15 

30 

85 

2 9. too mucii auto 

19 

48 

23 

18 

95 

30. reduce fatigue 

20 

67 

1 8 

25 

99 

31. -80 » progress 

20 

81 

12 

65 

99 

32. -80 new toys 

20 

29 

1 0 

1 

75 

33. ARTS * safety 

20 

67 

1 8 

10 

99 

3 4. -80 easier 

20 

60 

16 

25 

87 

3 5. I enjoy -80 

20 

75 

17 

48 

99 

36. use features 

20 

72 

16 

33 

99 
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Table 3 

Graphic presentation of attitude scales 


The following figures graphically depict the means and 
standard deviations of the 36 Likert scales for Wave One and Wave 
Two. The 36 scales are grouped by subject matter. The groupings 
are not by statistical clustering. 

Figure GlQUpiD.9 

General attitude toward automation and flying 

3-B Impact of automation on skills maintenance/erosion 

3-C Specific equipment capabilities; -80 in general 

3 -D Pilot age and acceptance of automation 

3-E Equipment reliability and safety 

3 -F Impact of automation on perceived workload, 

fatigue, motivation and cockpit management 


For each scale, there is a pair of lines: the top line j 

represents the data for Wave One, and the bottom line for Wave j 

Two. The center of each line is the mean, and the length of the fj 

line in each direction from the center is one standard deviation. 

If the distribution of responses to the Likert scales were 
normally distributed, the length of the line should represent 
about 68% of the responses. See Table 2-A and 2-B for exact 
values. 



Figure 3-A 
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Am. General Attitude toward automa tion and fly in g 


1. Flying today is more challenging than ever. 

2. I miss the "good old days" of simpler aircraft. 

6. I think they've gone tco far with automation. 

7. I can fly the airplane as smoothly and safely by 
hand as with automation. 

8. It is important to me to fly the most modern plane 
in the company's fleet. 

9. I look favorably on automation in the cockpit — 
the more the better. 

10. I am looking forward to even more automation in 
future planes. 

18. Automation is the thing that is going to turn 
this industry around and make it profitable again. 

19. Automation may be helpful in long-haul operations, 
but not for short-segment operations like ours. 

20. All these new features are nice to have, but 
they're not worth the money. 

29. Too much automation can be dangerous. 
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DISAGREE 


DISAGREE 


NEITHER AGREE 
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AGREE 


STRONGLY 
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Figure 3-B 

£l» Impact £& automation .UQ skills maintenance vs. erosion 

3# I am concerned about a possible loss of my 
flying skills with too much automation. 

4. I hand fly part of every trip to keep my skills up. 

5. Hand flying is the part of the trip I enjoy the most. 

4 . 

13. Pilots who overuse automation will see their fly mg 
skills suffer. 




-» 

i 

4 

i 







\ 







Figure 3-C 


£* .Sp ec i f i c equipment capabilities, .and the In ^rai 


11. I wish we had full autothrottle on the -10s, 

-30s, and -50s. 

22, Autoland capability would definitely enhance safety. 

24. Cat II and Cat III operations would mean very 
little to our company. 

31. I think that the -80 is a significant step forward 
in short and medium haul aircraft. 

32. The -80 is just another DC-9 with some new toys. 

33. The ARTS feature of the -80 is a real plus for 
safety on takeoff. 

34. Flying the -80 is definitely easier than flying 
the older models. 

35. i enjoy flying the -80 more than the older DC-9s. 

36. I like to use the new features of the -80 as 
much as possible. 
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Figure 3-D 


D. Pilot age and acceptance of 


12. Younger pilots catch on to automation faster than 
older ones. 

16. Older pilots seem to resist the new technologies. 


Figure 3-E 


JL* Equipment reliability And safety 


25. I have serious concerns about the reliability 
of this new equipment. 

26. I am worried about sudden failures of the new 
digital devices like the DFGS and the ARTS. 

28. The new equipment is more reliable than the old. 




Figure 3-F 


.Impact .of au tom a t i on on perce i ved work l oad, .fatigue 

motivation, and cockpit 


14. Automation frees me of much of the routine, 
mechanical parts of flying so I can concentrate 
more on "managing" the flight. 

15. I spend more time setting up and managing the 
automation (such as the DFGS) than I would 
hand flying or using old style autopilots. 

17. Automation does not reduce workload, since there 
is more to keep watch over. 

21. I use automatic devices a lot just because I find 
them useful. 

23. I use automatic devices mainly because the 
company wants me to. 

27. Automation reduces overall workload. 

30. C erall, automation reduces pilot fatigue. 



Table 4-A and 4-B 
Frequency-of-uee chart 


Crew members were instructed to enter into each appropriate cell 
the per cent of legs on which they used each -80 feature, during 
five phases of flight. Thus the numerical values from 0 to 100 
could be entered. 

Some of the cells are by their nature invalid - e.g. autobrake at 
cruise. Crews were instructed to place an "X" in each invalid 
cell . 

Examination of the data reveals that there was some confusion 
about this instruction, and in some places entries, particularly 
zeros, were placed in invalid cells. Thus, the reader should not 
take seriously the statistical values for cells with very small 
sample sizes. For example, three respondents entered a numerical 
value for the use of the dial-a-flap at cruise. 


The data are expressed as follows: 


Mean % 


Standard Dev. % 


(Sample size *) 


For example, the Wave One data for altitude hold at cruise reads: 


meaning that the mean usage of the 34 pilots responding was 94% 
of the legs, with an S.D. of 23%. 


* Number (out of total, responding with numerical value. 






Frequency of u»« ~ H«v# 




3 » 
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Table 5-1 to 5-5 
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Table 

5-1 

5-2 

5-3 

5-4 

5-5 


Open-ended questions 


Question 


What feature or piece of equipment not presently 
in the -80 would you like to have installed? 

Since flying the -80, have you seen any confusion 
or incorrect operation on the part of other crew 
members? 

Are there any features or modes of the -80 that 
you are still not sure of or comfortable with? 

What feacures were the hardest for you to learn? 
What do you think the problem was? 

If you could make any changes in the cockpit 
layout, equipment or modes of the -80, what would 
you like to change? 


* 
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Table 5-1 


Question 1. What feature or piece of equipment not presently in 
the -80 would you like to have installed? 


Responses : 
Wave 


Equipment 


1 2 


Performance data computer system (PDCS) 

Long range navigation * 

Groundspeed readout 

None (stated as such - not blank) 

Blank 

Non-glare glass on all instruments 
Improved pressurization control 
Individual heading* airspeed controls for DPGS 
Push-button entry for zero fuel weight 
Forward "blue room" (lavatory) 

Mirror to check wingtips 

Red light illuminating V-speed book 

Collision avoidance system 

Doppler radar 

Red instrument lights 

Standby frequency on VORs 

Aural altitude alert 

Head-up display 

Wind shear detector 

More visible "caution" lights 

Faster cancelling of gear-up warning 

Stabilizer adjusting syste 

Pencil holder 

Overhead hand hold to aid seat adjustment 

Improved light rheostats 

High frequency radio 

Improved seats 

Cat II capability 


8 

7 

5 
2 
2 
1 
2 
2 
1 
1 
1 
2 

3 
1 
1 
1 

6 

4 

* 

x 

1 

1 

1 

1 

1 

1 


3 

3 

3 

2 

3 


2 


1 

1 

1 


1 


1 

1 

1 


Total responses 


57 23 


Include r RNAV , Omega, and INS 
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Table 5-2 

Question 2. since flying the -an k 

langu^ge^f thl ?«po?dMts h * I *„ P ||» lbl f t0 P«»«ve the exact 
compactness, the language u p i aces ' f °' clarity «° 

yes/no are not included?) P Phrased. Replies simply 


HAVE QNF 


• fluids 


respondents) 


■ B Zat£m JLd -genera) 


standardized* 10 * 8 * ° nly ln new crfcw members. We are well 

^ n ^ S ^^«-? ra ^? b < nr shin S the wrong Putton. deprograming 
Minor errors in the DFGS setup. 

^respondents^ ^ ^ ilA£il ilQld ^nd .speed Marh se i^«- 

features ?" 8 ^ Seem to re *^* that these are distinct 
Confusion as to what- t-v.~ 

as? &s? - --S ss-ssis-a- 

New f/Os not sure which mode to use. 

Spa/Hach control usage at intermediate altitudes - esp. l0B lt .. 

4Ut “ thWtU ' £ * at£ “ (8 respondents) 

Managing the ATS, esDeciaii,, 

a low level off - e .g. ' ie/el^oor^Zn^oV^ “ Uh 
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SAm*/S 


r y 

f 
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Clamping ATS when they didn’t mean to 
Excessive use of ATS at low altitude 

Initially confusion on how to maintain throttles at idle 
descent 

Waiting for power to come on in descent 

Use of spd select during idle descent on profiles 

Spd sel knob hard to operate in fast slew position 


d. A/P And A/T interaction (5 respondents) 


•It's hard to program A/P and A/T fast enough to keep up with 
ATC, so we uncouple and fly by hand." 

Confusion about overlapping functions of the A/T and A/P and 
improper interpretation of the FMA before mode selection. 

Unfamiliarit^. and incorrect use of A/P and A/T for takeoff, 
climb and descent. 

"Most incorrect operations center around the use of the A/T and 
A/P speed control, resulting in a CLAMP indication on the FMA." 

e. Sy s te m ApexuiLLon In gener al <6 respondents) 


"It takes two months of line flying, about 150 hours, to 
understand all the systems." 

"Not always in proper T/O mode when we begin T/0 - mode confusion." 

Controls are more sensitive - hdg knob, alt select... it takes a 
lot of time and experience. 

"Reaching to wrong positions for switches and radios - it's 
different from other DO- 9s." 


f . Q.theC comment? 


Forgot to select speed/Mach selector for cruise speed. Same 
comment after descending to new altitude. 

Pilots not arming altitude alerter. 

"Flap retraction time, and turn with altitude restriction. 
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forgetting to reprogram, so I'll snap off A/P and A/T and hand 
fly. " * 

Difficulty in operating flap handle after dial-a-flap T/O. 

(2 respondents) 

Confusion over which function to use, like SPD SEL or CL-EPR. 
Hard to set up DFGS for back-course ILS 
Flap/slat retract systems 


* Not clear what is meant by reference to flap retraction time. 

WAVE TWO 

a. Autopilot .and JJLiaht guidance system jjj general 
(6 respondents) 

Having A/P disengage for no reason causes real confusion, esp. on 
IFR approaches 

Forgetting to put in new altitude to capture 
Moving pitch wheel when capture has started 

Forgot to set assigned altitude and forgot to push Mach and A/S 
on A/T control 

Turning the wrong knobs, like course instead of hdg 

In leveloff, tendency not to let the A/P do it for you - 
reverting back to earlier aircraft 

b. Confusion Detwe IAS .and Mach hold, and :, peed and Mien 
select (none) 

c. Autothrottle system management (7 respondents) 

Management of ATS and speed selector in general (3) 
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A/S knob clumsy to turn 
ATS surging and clamp mode 

to S h»p P M** ° f oonfusion duri “9 a bu »y approach when things start 

<3. Alld AZI interaction 

"Conf using"’ (2) 


e. System operat i on -i-D general (6 respondents) 


Pushing the wrong button (Spd/M) (2) Spd/M and hda kroh 
“‘i" » and sometimes have the He “2bSS (e?g 

3 hdg. and airspeed). Captains manipulate the wrong on< 

Grabbing i:he wrong knob on the DFGS 


too 

210 

often. 


Misreading the A/S bug for the V-ref (white) bug 

SSJSWSS ^T £Up because settin * «•»«*» 


can't be 


"Most of us have been in the -80 for quite a 
the incorrect procedures are just a matter of 
and not thinking” 


while, and most of 
getting in a hurry 


f . Other comments 


Forgetting to put in the new ZFW 


Forgetting to slew the heading bug before T/O 


chinge 6 ^" 9 ^ FMA When making a speed. 


heading, or altitude 
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Table 5~3 


th *f* f" y «r modes of the -80 that you 

are still not sure about or comfortable with? * 


uS-SS'S parentheses ) >0ndent t0 th " Cl0Sest 50 h °“” is 


WAVE ONE 


No (800, 100, 500, 750, 400, 150, 550, 600, 1000, 1200 flnn 
150, 100, 50, 200, 400, 100 , 300 , 450) ' ' 8 °°' 


be°iade t --°Sach y h«?H Uld b * !nor « specific on how descents should 
is the tey £* SS53' “ CU " P ' Stand -drzat ion 


mJ!n^K CX K eP u that the plane is so automated that my last 6- 
month check was not exactly perfect." (600) y 


"I’m not sure why, after cruising at M. 76, when you Dush in 
speed/Mach set knob, it reverts back to Mach after display ina 

you 8 ^?;. ’W b8Ve t0 PUSh " Peed to"eep S ?he y spe 9 ed 


course 0 *" 1^°^ il^ 1 * W j th tht \ A/p to intercept a LOC/GS 
establish 1 t • mucb smoother and almost immediately 

SeltuH?! aSo) COtrectlon crab - Then ri1 e "9 a 9 e the 


a f m f eatur ® sometime disarms itself. a/T lags behind 
speed selected and then over-controls to get speed back A/T 
oscillates excessively in cruise." (400> 9 (Sef footnotei p 87) 


1 m n * w and m y “ 0O time has been spread over a Iona 

• C ° nfil ^ t with A/T and A/P and some nomenclature 9 
(confusing). Also IAS/Mach hold.” (50) re 


’Speed/Mach selector does not always change to correct mode." 


ns's-s: gia.*ssr!- >• ■> 


"A change in clearance within 20 miles of an airport seems to 


increase my workload at my experience level. 


(50) 
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ATS (50/ 200) 

•-80 doesn’t descend like other DC-9s. A/Ts often spool engines 
when not wanted (often not noticed at night) when trying to 
descend. End up high and fast on approaches, so you have to plan 
further ahead with cushion.” (150) v 

Turbulence node — haven't needed it yet (400) 

^150) ° n ldle P ° Wer descents coroe U P when 1 think they shouldn't 


Still don't understand the ATS. 
and reconnect for final approach 


I disconnect them for descent 
(400) 


Use of DFGS on back-course ILS (400) 

"Altitude hold I've seen A/C leave captured altitude four 
times. Each tine the alt sel knob had slipped into the next 
detent, higher or lower" (200) 


WAVE 


No (400, 800, 1350, 350, 600, 900, 1150, 1200, 800, 700, 600 
700, 600, 700, 400, 800) 


Alt capture and approach capture and track on A/P (400) 

Using dial-a-flap settings (400) 

LOC-only approach — push VOR-LOC for capture; push ILS and it 
will still capture (100) 

Autoland and auto G/A (350) 


A/Ts sometimes clamp at wrong T/O EPR (600) 

VOR capture and track mode not very smooth for the money (600) 
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Question 4. What features were the- hardest for you to learn? 

Question 4(a) What do you thinx the problem was? 

(Flying time in -80 to closest 50 hours in parentheses) 


MftYE QEE 


A/T and speed/Mach and its relationship to pitch (800, 150) 

A/T. At time instructors weren't sure how it worked (150) 

A/T. Reverting to Lo Lim after being retarded (150, 150) 

A/T. Not enough instruction (150) 

A/T in general (50, 150, 150, 200); Integration of computer into 
specific modes (50); Inadequate training for modes (150) 

A/T smoothness — trying to cope with built in problem (200) 

All systems fairly easy; no difficulty (300, 1200, 600, 50) 

Remembering to put proper flap setting into CG computer and 
stowing the flap detent on climb check) ist. Rushing to get 
everything done between the time when I get weight tab and enqine 
start (300) 

DFGS (500, 800, 400, 100, 400). Lac*' of experience. Easy to 
learn, just more to learn than anything else. "I’m not used to 
computer s." Way it was presented in ground school. Lack cf a 
simulator. No simulator, just a static airplane 

Getting used to quiet cockpits after flyinq -10s (750) 

A/T - A/P relationship (600, 150, 50, 550, 100, 400, 400) 

Lack of experience - I fly -30 a lot (2 respondents). 

Extreme number of possibilities with new features, and 
company's insistence on using their, all most of the tune. 

Some nomenclature doesn't help. 

I think the two systems (A/P and A/T) should be taught 
separately, then combined. 

Different ways to make a proper descent. (800) 

Descents are the only "zone of confusion." 
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Speed/Mach selector. What you get when you push in on the 
button, depending on what mode you are operating in, seems 
confusing. Confusing part is keeping in mind what mode you are 
in. (400) 

Selecting proper mode and checking TARP * (400) 

Adjusting to female voice on CAWS. Male voice would be better - 
I tend not to listen to women. (500) ** 

Sequencing the DFGS to produce desired effect. (1000) 

New abbreviations - e.g. FMA *. Nothing to relate these to. (100) 

Interactions and priorities of systems. You must fly the 
equipment to find best way to put it together. (50) 

SPD SEL vs. IAS hold - continuous reduction of speed bug to 
maintain unspooled condition. Difficulty with different modes, 
but this was corrected with experience (150) 

Checking the FMA (200) 

Touching vert spd wheel disconnects ILS (100) 

Use of hdg sel in flying VFR approaches. Too much time with head 
in cockpit. I'm used to DC-9 turn knob - can vary bark angle 
without looking in cockpit. 

None (1200, 600) 


* Flight mode annunciator (see Glossary, Appendix 3). 

** Not clear whether this is facetious or serious comment. In 
interviews many pilots objected to the CAWS, but not specifically 
to female aspect of voice warnings. All but three of the 
warnings are female voices. 


WAVE TWO 




None (so stated) 


(1350, 1150, 


800) 


I fly the -80 on reserve. There's no continuity in 
I can fly the -80 only twice a month - it screws up 
habit patterns. (400) 

Insufficient training - no simulator (700) 

Control during descent (400) 




operating it. 
learning and 


Separating A/T and A/P functions in my mind due to previous 
habits (350) 



Habit interference from -50 (350) 

Making smooth descent and landing - lack of experience (800) 

Interrelation of A/T modes and speed functions. Poor instruction 
from the factory in relationships (600) 

A/T in general; lack of training (700) 

A/T functions too complex (100) 

A/T, Spd/M and A/P control; lack of proper greund school 
preparation (400) 

FMA - learning all the modes and learning to watch it (600) 

ATS in descent - hard to get slowed down, esp. if you stay high 
E . for fuel conservation and ATC gives you a speed restriction in 

» descent (900) 

ATS in descent - lack of experience. Descent and approach phase 
are more difficult with this system (700) 

Connecting A/P smoothly so soon after T/O; rate of climb between 
A/C and A/P are not in sync (1200) 

Separating A/P and F/D in my mind; pushing IAS on A/P when I 
should have pushed F/D; the problem was me (600) 
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Table 5-5 


Question 5. if you could make 
equipment or modes of the -80, 


an y changes in the cockpit layout, 
what would you like to change? 


WAVE ONE 


Nothing (so stated - not blank) (8 respondents) 
Left blank (3 respondents) 

Aural speed brake” warning (on touchdown) removed. 


goes off, we lose altitude capture. Chanqe 
so that anytime A/P is coupled, we would have alt capture. 9 

Individualize DPGS, A/S, and heading bugs. Make it possible to 

!?•* <u ? h « d p« h "nob i5d p sti“: co 

Also for ys and heading you have to look in two places, the 
instrument itself and the DFGS (to set bugs). 

Cockpit lighting. (8) 


In summary, complaints about the white lighting, and 
necessity to turn up floods to see the V-speed card. 
Recommendations for red light over the V— speed card, 
recommended lighting be like older DC- 9s. 


Several 


Better way to prevent accidental tail cone deployment. 
Ground-speed readout should be added. 


"Desensitize" A/T at cruise. 


Have VOR accept drift correction that has 

Backlight following switches: IAS hold, 

Mach sel , VOR/LOC, ILS. 


been established. 
Mach hold, EPR lim. 


in^ 81 l* nCe S AWS ‘ < 2) 0ne su 9gests mounting it or control 
wheel, and eliminating 801 of CAWS alerts. 

Seats are uncomfortable (2) 

Interference when ATC gives a change and capt. reaches for 
ait knoD as F/0 reaches for ppiiitch wheel. 

Comparator between the two A/P computers. If one goes bad, 
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both are inoperative and you have no A/P. Should be a way to 
override them or separate them so the good one can be used. 

Amber light on radar altimeter too bright, esp. with voice 
warning of "minimums. * Seen as "distracting and unsafe." 

Get rid of ATS 


Make pressurization more automatic — like Boeing (727-200) 

vocation of wing light switches, and other external light 
switches. Nose light switch is mounted slightly higher than 
the wing light switches. Makes it appear that landing lights 

ln ra * d or exten< *ed position. Not so on older models of 
DC- 9 - they were aligned. 

Two heading knobs and two pitch wheels to keep from getting in 
each other s way. 

Change speed knob to have different feel from course knob (2). 
Better speed knob (1) 

Suppress voice warning system on ground. 

Altitude alert - takes too long to select the 100-foot levels. 
Remove ALFA speed on A/Ts. 

Old style (dial and pointer) fuel gauges (in place of digital). 

Change trigger point for gear warning from 210 knots (presumably 
to lower speed). 1 


Eliminate undesired engine rpm increase when gear is lowered. 

Move descent wheel (vert spd) and turn knob to center console. 

CAWS warnings too "piercing" — make more subtle and less 
repetitious. 

Update flight and performance instruments and displays to more 
modern# easily-read# like C-141 tape instruments. 

More reliable air data computer 

Go to -50 A/P with spd/M hold. 
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None (ao stated) 

Blank (2) 

Move green oxygen bottle to corner 
Relocate turn knob to center pedestal 

Cockpit lighting: general (2); red lighting on V-speed cards (7) 

Change feel of knobs for A/S and course (make distinguishable) 

Put in 20 degree flap notch so you don't have to dial it (2) 

Relocate TCI * on the pedestal behind the throttles with 
annunciator in the same place 

Change gear warning to 180 kts 

Relocate pitch and roll inodes of A/P to center pedestal 

Functions related to each pilot's task should be assigned to his 
side of the cockpit 

Add a minimum fuel warning 

Vibration monitor more centrally located 

Give each pilot his own hdg and spd controls 

Make it easier for F/O to load the correct ZFW — has to reach to 
captain's panel and twist knob 

Change A/S bugs so DFGS and V-ref are not confused so easily 
Flap/slat handle should be as easy to move as other DC-9s 
Add groundspeed readout 

Eliminate unnecessary CAWS warnings — like landing gear above 
5000 feet and spoiler deployed on ground 

Make it like a -50j eliminate all the training and cockpit 
confusion. We made it a separate status, proving that, pilots 
find it tough to go back and forth. 


* Thrust Computer Indicator (see Glossary, Appendix 3). 
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Difficult to select TCI — esp. at low altitude, critical tiroes 
of flight 

A/S speed bug should be visible under all conditions 
Smoother operating A/Ts 
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Table 6 


The following comments were written on the Wave One 
questionnaire forms? in response to no particular question. 


1. I have been flying from MSP to PHX to SNA. The weather has 
been very good most of the time? so we have not made any ILS 
approaches. When the weather is bad coming into MSP, we mostly 
use the autopilot coupled with ILS. It works very well. I have 
never used the flight director very much on any airplane, so I 
can't use It much now. However, I use it 100% for takeoff. I 
think the autopilot-autothrottle combination works very well. 
However, I must use it regularly, or I will get rusty with it. 
Also my instrument flying ability has gone down hill. Flying the 
-80 you are really only a computer programmer. I now have 
decided to fly the -80 one month and the -30 one month, rotating 
back and forth. If the company wants us to fly the -80 all the 
time, they should give us who want it a couple of hours per month 
in a -30 simulator to keep our instrument flying proficiency up.* 

2. My most difficult task is a high VFR approach to an airport 
that requires rapid changes in airspeed, configuration and pitch. 
In this case I can do a smoother job hand flying. I don't have 
the eye-hand judgement coordination down yet when using the DFGS. 
Also, if the station used in VOR Nav is oscillating, I fly 
heading select because it's smoother. 

The -80 is paradoxical. To be effective, safe and smooth with 
the automation, you must use it as much as possible. However, I 
am afraid I will lose touch with my manual flying skills if I 
don’t fly it manually as well. I feel pilots flying the -80 
should only fly the -80. The programming of the DFGS requires 
too much time with eyes in the cockpit if you don't fly it 
regularly. I feel that once you become skilled in programming 
the DFGS, you can keep your eyes outside more and it will be 
safer. Overall, I think the -80 is the neatest thing since night 
baseball. 

3. TRI (Thrust Rating Indicator) - there is no specific setting 
for descent. It will remain at CRS 'cruise) until set to GA (go- 
around) during the in-range check. 

Speed/Mach Control - It is my policy to have the internal bug set 
(by using this control) at my target IAS/Mach regardless of the 
use of the aucothrottle. 

* This problem was largely resolved by the introduction of the 
"separate status" agreement. See p. 96, paragraph 10. 
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VOR/LOC Capture - Used very little since the equipment is much 
too sensitive relative to the quality of the nav aids. The A/C 
is much too •jerky" on the Loc and "sloppy" on voRs. if these 
inadequacies were corrected, I would use the capability from 75% 
to 100%. 



Autobrake — I only use about 25% of the time - short runways, and 
high gross weight. I normally don : t manually employ the brakes 
until below 80 knots. 

4. I find that X am so busy with the automated portion of the 
aircraft that I am not looking outside the cockpit. I feel, 
however, that as I get more proficient, this will changed A few 
hours in a simulator with a good instructor could have made by 
transition much easier. 



y 
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[ V. CHEt-ix “MAN INTERVIEWS 


DC-^-80 check airmen were interviewed in Minneapolis and Las 
Vegas. The intent of the interviews was to explore the 
experiences and difficulties, if any, encountered by the newly 
transitioning — 80 pilots. In many instances it was difficult to 
separate this question from the check airman's own perception of 
the airplane. The comments are summarized below by general topic 
areas. In some places these are direct quotations, in others 
paraphrasing. Since check airmen were interviewed separately 
from line pilots, no distinction is made here between first and 
second wave interviews. These interviews occurred throughout 
the study, due to the fact that new crews were being trained at 
the two -80 domiciles at various times. Most check airmen 
interviews were performed early in the first waves at MSP and LAS 
in order to probe opinions during initial checkout and traininq 
of the -80 pilots. y 

Overall evaluation 

New pilots tend to get behind - head in the cockpit. The FMA is 
new and they don't understand the modes. It takes one trip just 
to get the SPD/Mach control straight, and longer to master the 
FMA* 

It's a new environment and people don't realize now different it 

is, especially when things go wrong. Lot of pilots think of <t 
as an old plane with some new systems. But it's heavier, faster, 
and longer. Things go faster. The biggest problem is getting the 
three systems (F/D, A/P, and A/T) working together - it takes 
longer than I would have thought. It takes a month just to be 
able to operate it. The secret is scanning the FMA. 

Overall, the system is ’stable' since you can always push the 
yellow button (A/P disconnect) and turn it back into a DC-9." 

Questions the dollar value and wishes the company hadn't bouqht 

it. Likes the fact, that the heading bug can be set from either 
side. Otherwise prefers the -50 avionics. 

In Initial Operating Experience (ICE) , pilots had head in the 
cockpit too much. 


Attitude And resistangp 

Tendency of new pilots to "give up." "If a problem arises 
(e.g. computer failure), neophytes will give up instead of trying 
to solve the problem. A simulator would help 100%." Sees some 
resistance to new features, especially on first trip. Some see 
cockpit as "too complicated" at first, h ,n t when they master it 
would prefer to fly the -80 over other models. 
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S °“ e said tha * '' ould prefer that -30 
jusc De a new DC-9 with 217 engines, and no new features. 

Pilots didn’t like ground school - called it computer 
^°^r?“o? 9 n e wco««s- ee diStinCt pha,ie8 ° f attitud « <=e«rd the -80 


1 . 

2 . 

3. 


•It's just another DC- 9" 

^It's neat - it's fun to fly" 

"It doesn't work" - skepticism about the reliability 


Complacency would be the big problem if the stuff unriroH t«-« 
a good thing that automation does not work all the tiJie?"’ S 

P . e li ahil i tY/Conf i den^ In the plane 

Complaints about the 904 flight guidance computer two rhe.v 
airmen reported that with bank angle lirUe^set w ™ deSr.es 
the plane would bank 4b degrees, and attributed it to the 9 904.' 

Unreliability of the equipment is the biggest problem * 

tha^if both^au 6 ^ 101 ^ th * problem ^lso attributed*to the 904) 
that if both Nav receivers were not set to the same ils 

frequency, the plane would fly through the localizer without a 

capture maneuver. Also mentioned were brief interruptions of the 

r SSTU “ he " P °"« “ a8 restor^“ P U bight ^ 

Have seen it (altitude hold) disconnect and leave an 
we f didn t catch it till the 250 (actually 200) foot ala™ went 

"Do^n'f m ^ f a A/T cruise, especially in mountainous terrain. 
Doesn t do as well as the -50 in IAS and Mach hold." 

■Skil l a cqu i s i t l on/ 1 OILS and t:ra inj ng 

S'i” srsw 

^ l0t ?K talk ab0Ut " loss of scan," but I don’t worry about 
t. There is no skill loss as long as I hand fly some. His 
practice is to hand fly below 10,000 feet on every third lea and 

m Doesn,t 888 d -^»- 


* See footnote, p. 85. 
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Doesn’t see any problem. Use everything that is there, and hand 
fiy occasionally. 

Most pilots like to do some hand flying. All should be made to. 
Check iuHn flies en entire leg by hand, but admits that it is 
less economical — that A/P and A/T combination can fly tne leg 
more economically. "My scan pattern would be zero if I usee it 
(automation) all the time*" 

There is "major confusion* between the A/P and the w A/**, e.g. CLMP 
annunciation. LAS pilots didn't fly the -50, so they did not 
hJCe Such experience with Mach hold and IAS hold. Former Boeing 
pilots did better in transition. Problem was which mode to use 
to hold airspeed. 

At SNA, new pilots didn't know how to pull the power back at 
1000* (for noise abatement cutback). 

Secret to flying the -80 is "do what it take to give a smooth 
ride and reduce workload. Don't get 'stereotyped. Use 
automation when appropriate." 

The basic problem in school was "bits and pieces" - e.g. the A/P, 
A/T, and F/D. But the plane is one package, and this should b 

emphasized in school. * 

Pilots should ride the jumpseat before going to school. 

It takes 50 to 100 hours to be comfortable. Out-the-window time 
in the -80 is about half what it was in the -30. We're too busy 

inside. 

The problems are consistent. At about 10,000* we get behind and 
high! The "whiz wheel" (hand-held vertical descent computer) 

prevents this. 

On a coupled approach, trainee hit the wrong button - VOR/LOC 
instead of ILS. You need to learn to "preprogram , especial y 
the speed bug. Complains of "fixation on digital displays. He 
puts tape over speed and heading window on DFGo toj^ce trainees 
to look at the bugs. On older DC-9s, the control and 
information was in the same place. 


* See Page 96, paragraph 11. 


frinritinad. fatigue, .and "out -t he-window" -time 


One pilot sees little difference between 
earlier models in this repsect, but the others 
workload is less and fatigue less, once pilots 


the -80 and 
stated that 
become familiar 
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with systems and procedures. Two stated that the -80 allows more 
time for out-the-window scan. 



"After a couple of months, an -81 is easier to fly. I could fly 
it longer (than —50) and feel less fatigue. " 

"There is less fatigue if the systems work as designed. If you 
keep up with the plane, the -80 allows more out-the-window time." 

One check airman expressed belief that there is more requirement 
for monitoring activity in the -80, but another who mentioned 
monitoring said it was no different than the -50, which also 
demanded a lot of monitoring. 

Initially there is more workload, then less. But if you include 
monitoring, there is no difference in total workload. In a 
terminal area, you spend a lot of time monitoring and use your 
hands a lot, so workload may increase. 

f eature s - ihs Central Aural warning system (caw.p * 

Likes the CAWS and the voice warnings, but would also like to 
have the aural tone ("beep") restored to the altitude alerter 
(for 750 feet prior to selected altitude). 

•Overkill - the aural alerts are by biggest complaint about the 
60." It is distracting at critical times. E.g., you're high and 
slow down (below 210 knots) and get "landing gear," and it's too 
loud. "Speed brake" (after touchdown) is annoying. "Stabilizer 
in motion" is not needed. T/O configuration warnings are too 
critical - should have high tolerances (see next comment). 

Concern for the "cry wolf" problem (excessive false alarms). 3ut 
generally likes the idea of voice warnings, especially for T/O 
configuration errors (see above). Some warnings are annoying and 
distracting - e.g. "Speed brake" after touchdown. Complains that 
stabilizer in motion" does not always annunciate on ground 
check. "When a computer says something, it should be real." ** 

"As long as I can turn it off, it's OK." 

Objection of gear-up warning speed (2i0 kts.). It should be 180. 


* In interviews with check airmen and line pilots, comments 
acout GPWS voice warnings were often included along with comments 
on the CAWS. The GPWS is a separate system, but the two are 
often seen as one since they both give voice annuciations. 

** Most of these "false alarms" were associated with early 
models of the DFGC, and v.’er** corrected in later models. 
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Would like to mute some voice warnings 
critical) trigger points on others, e. 


» *nd set higher (less 
g. stabilizer in motion. 


Make master caution light brighter. 

Restore tone for 1000' before preselected altitude. 

CAWS is overdone. 'Speed brake' on landing is unnecessary, 
can be heard in the cabin.” * * 


It 


Other -specific devices 


Doesn't like radar altimeter - requires too 
Doesn't like voice "minimums” alert. 


many turns to set. 


1 2 * • ut th a crossin 9 restriction, the A/P trim 

lags behind, the light comes on, possibly no capture. 

A/P is too sensitive in pitch control - in turns as well as 
straight and level. Needs to be damped. 

Likes coupled approach especially for a low-low approach, but for 
less demanding approaches, prefers to fly with F/Sf On visual 

nn P ^hf C 5 n ll h e8 K t °- 4 U f? A/Pap * d spend time looking out the window. 
On the 50, he hand flew visual approaches. 

Confusion between A/T and A/P functions. "The plane is not a - 
30. if you fly it like one, you'll be high and late." 

P w l0 H 5 orget bank an 9 le limiter and leave it at 15 degrees. It 
should be at 10 degrees above 180 kts. 

Several mentions of killing the altitude capture by moving the 
vertical speed knob. y 


Flap handle is a problem for the F/O. . . dif f icult to seat. 
Vertical speed knob is awkward, esp. in turbulence. 


The symbol (on MSI) for the course selector 
knob, but the heading (triangle) is an "H" 
symbol (red triangle) is also the same. 


(+) is also on the 
on the knob. Speed 


Dial-a-f lap 
indications 


and CG trim readout and indicators have opposite 
(numbers increase in opposite directions). 


Objects to vertical speed wheel 
console. 


on glareshield instead of center 


* 


Corrected in the 907 DFGC, 


approximately February 1985. 
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equipment, would you like £££? 


Area navigation (specifically mentioned Omega) (2 respondents) 
Head-up display (HUD) 


Collision avoidance system (CAS) 


Aural tone on altitude alerter (1000* before altitude) 




* 
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VI. LINE PILOT INTERVIEWS 


HAVE £H£ INTERVIEWS 


Why did you bid the DC- 9- 80 ? 


- 1 90t the ^ -"ce it 


New equipment - "intriguing." (5 respondents) 

New plane - advanced guidance system - "a neat DC- 9." 
Would have been forced to due to (lack of) seniority. 


Bneino tl ?7 5 7 ? S J e,DS * • 4 . I ^ read w UP «« At * nd P dS8ed U P 8 *>i<i On the 
Boeing (727) to wait for the -80. 


Good trips for commuters. 

Talked to pilots who have flown it. 


I alternate between captain on a Convair (580) and a F/O on the 
--"closer' Jo e tSe e 7i 7 /7?7? r ° th#r DC ~ 9S * It,S th * futUre qeneratio " 


New plane and new technology. More options for bidding trips. 


I'm low on seniority list - on -80 can avoid poor trips. Also I 
prefer new planes. * 


retirement tiCat6d equipinent * 1 bid ifc with only 2.5 years to 


Forced bid. Like the trips - higher utilization (more hard 
time; . 


Didn t know much about automation. Never thrilled with the 
Boeing, so withdrew a Boeing bid to bid the 80. I like 
McDonnell-Douglas ' approach to systems. 


Advanced aircraft. Didn't see the Boeing as an advance. 
New plane, new features, more engine power. 

Gener al comments -about ube rtfiQ .and aiitajaaiioD 


° n fuel efflcienc y- Will like it more when 
l learn the FMA better. 
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With rapid ATC changes, difficult to reprogram rapidly. (2) "In hand 
flying, the programming is done in your head.” 

Would have preferred to upgrade old fleet, e.g. strobe lights 

Would like to see more separation between the knobs (DFGS) . They 
should be shape coded. 

More difficult when you get last minute instructions (ATC) - e.g. 
to land on 19 instead of 25 at LAS. 

Like the flexibility of the options - wish I knew more about 
them. 

At first I was always behind. With rapid ATC changes I would 
click it off. Now I use automation all I can. First month is 
rough - more planning is needed due to faster climb rate. Glad I 
didn't have to go back and forth to older models. I've been in 
the right seat 13 years, and this has me fired up again. 

On 80, when I hand fly, I feel that I'm out on the end of a long 
pole (reference to length of fuselage and handling 
characteristics) . 

I like automatic systems when they work properly. Took less than 
a month to get comfortable. .. four trips SNA-PHX (four legs). 

It's clean, so you must plan descents earlier. Programming is 
complicated. 

Not enthusiastic about automation. Wish the company had bought 
an -80 with the new engines, but configured like 50. (2) 

Backlighting pushbutton switches on DFGS would help avoid 
confusion over modes. (3) 

Not completely at home yet. Today I had a G/A (go-around) at SNA 
due to small plane traffic. Due to complexity, I clicked it off. 
Over the years I haven't flown a plane with auto G/A so I flew 
the way I knew how. 

Ground school instructor at LGB was confused, esp. over DFGS. 

Still things I don't know. Instructors should have told us it is 
the same as the 50, the big difference being the A/T. 

Terminology is new (e.g. CLMP) . CSS was a good tool. 

Early difficulty - "which do I push now?" After two months, felt 
at home. CSS (cockpit systems simulator) helped teach how to set 
up approach. 

Even hand flying the -80 is easier (than otner DC 9s) - it's more 
stable. I've hand flown all the way from MSP to PHX. 




i 
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Not all that different - it's still a DC-9. But I can fly it 
smoother. Heading bug and bank angle limiter much smoother on 80. 

Reliability no problem in general. I have had ILS fail to 
capture. Plies too far, then tries to turn back and never gets 
to track. 

Less stable on final - since it's cleaner. Have to start 
dirtying plane earlier. Hard to slow it dcwn near runway. 

I had trouble breaking habit of going to the HSI for the heading 
bug. Also got the wrong knob on the DFGS — speed instead of 
heading. 

General concern about reliability of automatics. (2) 


Mhal da you 11 Jlb About xhs jlUh£? 

Smoother powerback 
Checklist almost same as -50 
Quieter cockpit (3) 

Not having to do uplatch check (landing gear) (2) 

A/T is labor saving (2). Less time managing power, esp. in climb 

A/S hold, esp. out of SNA 

TCI 

Forward blue room (lavatory) 

N-l sync 

Pressurization control 
Fast slew on the OBI (CDI) 

Automatic APU (2) 

Fuel counter reset - don't have to hold (3) 

Master caution and master warning not too bright (too bright in 50) 
Twin heads on com radios (10) 

No need to test F/D 

Individual volume controls on com radios (5) 

Radar easier to use (6) 

10-mile range on radar 

More positive response on reversing 

Digital readout of fuel and gross weight (2) 

Radio altimeter design (7) 

-80 is standardized across fleet 
Reliability high 
More engine power (4) 

Radar - low power - not afraid to use on ground 

Autoslats 

ARTS 

Dual computers - more freedom to set up different options on 
the two sides 

Location of nav receivers and DFGS - easy for outside scan 
Bank angle limiter 

Heading bugs can be set on right (2) 

DFGS in general (5) 
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Digital readout to TAS/SAT 

High performance wing 

Power and ARTS ("lost engine at sna — 

Big ADI engine at sna - problem was slowing it") 

Cockpit lighting in general (3) 

Turn wheel ("on 50s, captains snap it around") 

Glare shield location of DFGS 


bi JHhat Mould you xae 

SUitC sMb h s«Jtn9 Stab tri " COntto:L, in w «y of P/O's view of 

ssiSi* 6 - Have to use *** 

No 9 c °“JfP«d.«oaout ("light planes have outstripped 

Digital ADF doesn't have the range. I can get NARCO (msp) inr 
miles out in a 50, not an 80. 9 NARC0 (MSP) 100 

Night iighting white light reflects in windows. 

CD?" ^“252 vertical~speed Sheel ^ 

CDI knob should be down on or below HSI * eeA 

Too long to crank in ZFW (2) 

"• 76 pref errecMIach 37 '°°°- "“ d Cbart wight-alt- 

DFGS h ?« d Af? r ? d ^ h u” have t0 reach ov er throttles 
voR S f^? ff ected by cold prior to startup 

change 9 at 0 l«tio“^ssagf ^ ) n0 ‘ , ' ind heading for heading 

TM%MS°rLioS= t00 " UCh alike (s P d/M «d heading) (2) 
siSt D ??nK? d ° tS ? n Same lnstr un, ent confusing 

said "T^nd "LaL" £ "' id ° C fUU ’ WoUld be better i£ they 

JSS.^^ Ur ? S t0 SCt DH on the radi ° altimeter (4) 

SDd/M DH settin 9 only goes to 300 feet 

S P d/HoandrNav-lcontrols too simiier to be so close to each 

similar (digita/readings in windlws)" d IAS “* th ® Same or 
Chopped^of f o^not full circle) nose gear storing wheel catches 



n . . :hich 7 9 -j^r:nj::j: u ^;. f * iUd se ~- 

Nay l f requency lJ selector Can can S lose~decImal°port ion ’-^sual ly r S 




solves itself 

Autopilot JJ U21 

Not hard to learn - basically it's a 50. 

n _ «-ho LOOP-4 dsDarture (SID) from LAX, the A/P blanks out due to 
eliSb Also on SuSEL-4 from SNA, especially on Thermal 
t2S2lSS£' “can™ handle a Urge bank angle, big intercept 
angle, and rapid climb. (2) (See Figure 4). 

Rough on engage at 800 feet, if accelerating vertically. Should 
stabilize vert speed before engaging 

T «.Kaa i auo iftff e a 2000* at ORD. Never had it go wrong, but 
L ° Ve have 1 seen°capta ins fail to poll it out (arm alt capture. 

Host errors are our own fault 

It can bust an altitude on a rapid climb. 

si 

V2 4 10 « 142 kts. 

SSSS 5 ‘ 

alt hold. 

Good on VOR track (2). Not as good as I'd like - depends on 
ground station. 

I don't turn it on at 800 - I usually hand fly to 10,000. 

Out of SNA I was distracted by traffic - speed dropped to V-ref 
minus 5. 

ft pt-nt.hr ottie system (AI S1 

Excellent (6). Esp. on T/O. Great to set T/O EPR and climb power 

Hard to understand the IAS hold, then the EPR climb or S P^ 
select A simulator will help. The J04 computer has helped. 
Some C guys don^t like the low limit - they want the throttles 

closed. 

Hard to learn. Descending at M.76, at 2a, 000, you pull the power 
off and go to 310 kts. Can’t keep the throttles back a die. 

They tend to jump to low lim, Dut not every time. At cruise 
die* it off and go to the book. 
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Best feature on the plane (2). Easy to control spd, esp. i-> area 
like LAX where you're going to spd reductions. . .don ‘t have to 
work so hard to stay within 10 kts. 

Too sensitive in cruise (5). There are large EPR changes, even 
with the 904. Too frequent changes disturbing to passengers. 

Great labor-saving device. 

Like it on T/O and climbout (2) . 

Over level ground it's okay (at cruise), but DEN-PHX the mountain 
waves cause it to hunt. 

Captains are leery of the A'T - its tendency to CLMP. They blame 
it on the A/T and click it off. Captains try to fly it like it's 
a 50. 

Nice not to have to keep checking airspeed in climb. 

Nice in T/O, but it's best in cruise. Hold the Mach. 

Has been good since the 904 (DFGS computer). 

On descent, it helps to bring throttles up to Lo Lira manually. 
Gives a bump when engaging after takeoff. Helps to engage while 
flaps are still at 20 degrees. 

On T/C, doesn't clamp properly - too early or too late. On 
descent, it shut it off a Lo Lim once stabilized, and then turn 
it back on. But it helps reduce workload. 

Too "positive" in corrections. I'd like a sensitivity switch. 

I'd like it more sensitive on ILS, less at cruise. It's good 
on ILS. In IMC, I plug it in and fly it down to 100’. Oniy 
problem is vert speed adjustment. 



Hfl yiau JJJi£ ll&e jLhfi coupled a pproach op ILS? 



Favorable - no further comment (5) 

In IMC, I trust it. Some ground stations poor (e.a. LAS), but 
I'd still use it in weather. 

Excellent - but I get the urge to hand fly. 

Excellent if capture angle not too great. Pilot awareness is the 
answer. 

Failed to capture once at MKE . Don't recall if had both Nav 
receivers on the ILS. 


55 



a «, 




It’s perfect. On my first trip, to MKE, the weather was terrible 
and it was great. Rougher the weather, the better it is. 

Dislike - too much control movement. I can fly smoother. We 
know when to roll in and make drift correction. On a tight 
approach I prefer to hand fly with the F/D, but I like the A/T 
for airspeed control. 

It does ?. good job generally. I never fly raw data - I at least 
use the F/D. In the -50 I sometimes fly raw data. 

I like it - I have flown two ILS's with heavy X-wind, and like the 
way it handled it. Like the programmable bank angle limiter. 
Normally set it at 15 degrees, but will use 25 for LOC and VOR 
capture, glideslope capture and track. "I fly this A/C as 
automated as possible - that's what it's made for." Some concern 
over automation "clicking off" during an approach. 

Trouble free. More you use it, more you enjoy it. First two or 
three months people clicked it off. Three times I have seen it 
annunciate LOC CAP a 'd fly right through it. You have to watch 
it. 

Depends on the station. . .with a good station, it's excellent. 
"It's a shame to have to turn it off to make a landing." MSP is 
good, depending on the lead-in. I use it whenever I can. 

We did it on the -30 and the -50, but never used the A/T. I like 
the logic of the -80 approach coupler. Capture is good, but you 
can get a big A/T surge at level off. Glideslope capture and 
tracking good. 

Bank angle iv important. I make approach with it (limiter) set 
at 10-15 degrees, and depart with it at 30, especially if you 
need a big turn, like PHX east departure, or MUSEL-4 from SNA 
(see Figure 4) . 

I like to hand fly down from 10,000 in good weather, but would 
use coupler in bad weather* 

"Mixed feelings - if the A/P chokes, you're out of it (the loop). 
I have faith in the -80 A/P, but misgivings about using it too 
close to the ground. So far have had no trouble. 

Use &£ automation visual approaches 

It's harder with the A/P than to hand fly. 

Harder in -80 than -50 due to the turn knob in the 50. 

I like to use automation, including the turn knob. (Interviewee 
then described in detail a visual approach to 8R at PHX, from 
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MSP* Enters at about 225 degrees/ with heading of 260 preset for 
downwind (6000 feet). Turns base with heading select (4000 feet) 
and alt preselect ariued, then captures JLS loc and glideslope.) 

Easier (to steer with) heading bug until final. With A/T you 
have more time to look out — don't have to keep checking 
airspeed. 

Don't like it on a high/ fast approach/ e.g. visual to SAN. I 
shut off the A/T - it goes to LOW LIM too much I don't use ILS 
capture on a visual. 

I mix automation with hand flying on visuals- 

I don't use automation - too much time in the cockpit. 

I hand fly using A/T/ or use nothing. I am concerned about loss 
of skills. 

I use automation down to 200' 


r.entral. aural warning system .(CAHFl (see footnote p. 47) 
Favorable view - no further comments (4) 


It gets your attention 


No problem with false alarms 

We'll learn more about it in the simulator. We have no 
opportunity to hear the important warnings (e.g. engine fire). 

Easy to interpret - e.g. "FIRE - LEFT ENGINE," but it is not a 
workload reduction. 


It once yelled "FLAPS" on T/O. 
degrees." It ' s normally 20, but 
side, but it didn’t matter. 


They were properly set to 11 
11 for SNA. We set 20 on the left 


Don't like "STAB IN MOTION" (this mentioned by most interviewees) 
Don't like "ALTITUDE" 

Don't like "LANDING GEAR" - can't silence in advance 


On a rjshed ATC, where they kept you high fast, too much noise. 
(This pilot silences ILS-related ground prox warnings by 
switching off the JLS freq) 

Generally favorable view, but feel it "talks too much" (4! 

" MINIMUMS " message too loud (2) 

Should speak only for serious alarms (e.g. fire, stalx) (t) 
Good, but parameters are too tight on takeoff 
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Likes the 7/0 configuration warnings 
Likes fire warning and engine loss warnings 
Likes minimums warning on R/A 


Lixes configuration alerts for takeoff. 

"In any aural systems, _f you have to rely on that, you're 

1r£w?? y f? 1 behind !i he A/C to be hel P» d - M insists on it 

(CAWS), but I ve never been in a position to need it. At san t 
get sink rate (GPWS) on westerly approach. 

at P criti2al E tiie rn ^3) °" tOUChdoWn unn ecessory and is distracting 


It's overkill - esp. clacker plus voice on overspeed 


Complaints about "mysterious warnings" 
off left generator and got FLAP. Got 
false flap warnings on T/0. 


(2) . On ground, I turned 
"ALTITUDE" on ground at MKE. 


Like the 210 knot gear warning logic (4) 
Do not like the 210 gear warning logic (4) 


Got 


L 


e arn i ng And alerting systems 

Would like to have the aural tone (beep) for 1000 feet prior to 
preset altitude restored (6) 


Like it the way it is - light only at 1000 feet (6) 
Like ALFA speed protection 


On approach to SNA, missed the 4000 for 3000 light - got the 
voice warning from CAWS at 2600 feet. Had it programmed for 3000 
toot capture, but probably hit the vertical spned wheel. 


At night, when you start APU during taxi, the master caution 
lignt comes on due to low APU oil pressure. 


Master caution light too small. 


Au tobrake (abs) 


Summary - all comments were favorable to the ABS. Most aoreed 
that the minimum deceleration was adequate for most runways, that 
medium was needed for short runways, and most mentioned SNA as an 
airport where ABS was most useful. Most agreed that there was no 
need for ABS on a long runway. 
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I use it on every landing, usually at minimum setting. At SNA we 
use it at medium or maximum, especially at night. 

I use it only 5—10% of the time, for short runway or poor 
weather. I use it at SNA every time. Usually minimum but min or 
med at SNA. 

Especially good on the -80 since it is hard to get the nose down. 

Some ptoblem of individual variation in deceleration between 
aircraft. 

Use it 20% of the time. On one landing, the F/O misunderstood me 
and set it on max. It slammed the nose down. 


Dial-a-flap .and stab setting computer 

Complaints about the flap handle being mechanically difficult to 
work, hard to seat into gate (detent). (9) 

Hard to find 20 degree gate - not a positive gate. Can cause a 
configuration alert on the CAWS on T/O. (2) 

Talk to the man in the right seat - he does all the work. We 
usually go with standard settings (and don't use dial-a-flap) . 

Dial-a-flap adds to the workload, but it's at the gate. It is 
not being used to full efficiency - we need (takeoff) charts. 

I like the flexibility it gives. (2) Special mention of 
summertime T/O from DEN and PHX. 

Not sold on it. It's a pain to spin it so long just to get 20 
degrees; same for stowing. Stab setting window hard to read. 

You don't even need the number in the windows, just align the 
pointers. This is a busy time -setting the CG, MAC, stab etc. 

Not worth the trouble - gust add a 11 and 20 degree detent. No 
need for sta :> window. Just line up the pointers. If you go by 
the window a, id not the pointers, you'll get a configuration 
warning. 

Probably no need for it (dial-a-flap) since you have so much 
engine power. 

Why not a 20 degree detent? It's the only T/O setting we use. 

Complaints about "opposite rotation" of dials (numbering system 
in op£~s _e directions). (5) 
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set^the^CGl! NOt 3 WOrkload P roblem * F/0 has to lean way over to 

Wasn't taught a procedure, so I developed my own — six steps 
That 8 too many steps just to set the trim. P 

Stab and CG pointers do not line up on the same number. (2) 
flashlight li9ht t0 SeG the green index at night. I use a 

It's esstra workload. I prefer to go at 11 degrees (flap) so I 
don’t have co fool with it. p 30 1 


* 
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Note: at the time of the first wave interviews there was some 

disagreement about the proper way to operate the pressurization 

?o exSla?n £rie?iv Tyl ° f ^ Conu J ents with that question. 

3iL e JEif* n briefly, the recommenoed procedure called for settinq 

?^° n altlbude at th€ gate. An alternative procedure 9 
arose - setting in the cruise altitude by determining (from the 
linear scale) the field altitude setting that would correspond to 
the cruise altitude, then setting the destination altitude as 
before, on the way down. Interviewees,- particularly F/Gs, held 
rather strong opinions about the proper procedure. 

Standard procedure (never setting cruise altitude) (6) 

"Set it on the ground and forget it" (2) 

"It's beautifully designed" 

One captain reported he didn't know there was an alternative 
procedure 

"Set it at the gate - less workload" 

I ve tried both ways - now I just leave it alone" 

Alternative procedure (7) 

workload*" " iSC altitude ' then set destination. It doesn't reduce 
Other comments - 

Window reads in 100' -- 1000' in all other DC-9s 
"I set it the way the captain wants it set" 

"Easy to make a 'times 10' error - setting 700 for 7000" 




/W/ 


Excellent. Very accurate 

iet*TDZE'iS«^ t ^ d .S £ f CrU j Se J PL ' esp - i£ we are 9hing high. I 
set TDZ E instead of PE for landing. At LAS, there's a 100* 

difference on R/w 26 end you get e bump (on depressurization). 

■ Potent iAl l os s Af proficiency .due in autnrna ?• j nr, 

No jirobiem since we fly the other DC- 9s too. (2) I hand fly 
complex procedures like MUSSL-4 SID (SNA) (See Figure 4). Easier 

in on 5S*Sh&&! checkin9 DFGS - This - “ h - * 

Sometimes I fly the F/L only, though I prefer to fly full 
automation. I never fly raw data except on back course. No 

r " for Pf of ^ cie n c y - "5ss - I just had checkride - thought 
about it a lot F but had no problem. ^ 

Some concern. I can already see a loss in skill, but will make 

?R> s; vK^i^uSfS/S 171 ? 9 - In IMC 1 ai - a ^ $ «“ 

r/u. m vmc, I li use F/D only, or even rav data. 

I™* 1 ™ !p ? Ct juS * automafc ion in 80, but fewer legs. We are 
hind flyiSg^* 9 * 3 Y ' ^ ^ ~ 8 ° U ’ S f ° Ur * 1 Sh ° uld do n,ore 

a -heckride in a -10 simulator — no problems. Company 
wants you to use automation 99% of the time — no problem for Y 
experienced DC-9 pilot, but for new pilot it could be. 

I have some concern. In VFR I hand fly. m ifr, I fly F /D onlv 

flying and 1 9 et ATC callp I'll throw on 
checkride. A ^ ere would be no P roblem if I had to take a -30 

iiIe W it'I e fur S t Q I dn and T fly ?H e K leg each trip ’ I<: hand flies so 
nice it s fur. to do. I would have no worries about jumping in a 


and la t .i q . ug compared .to ear lier or- 


'slightly less" (8) 

'slightly less, but not the 40% less they (manufacturer) 
'20% less" (3) 
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*25-30% less* 

"501 less" 

"Considerably less" 

"No difference* (3) 

More (2) 

More mental workload* but overall less 

Overall less due to the longer legs in the 80, not the equipment. 

Overall about the same, but can do more at the oate -h i* c *. 
do at peak times in flight (2> e sat ' and less to 

Less time to look out to window 

If you've armed it, you have to monitor it like crazv So 

s r ; h ;s Tim rtwrzj?i!'' ln * n ;% s u ' s a 

emphasis on conunand responsibility at the gate, m ° re 

l^" 0l ? SC ?° 01 *" 1 spenc a lot of time seeing that it 

^automation) is doing what it's supposed to do? 

Less workload as long as things are ideal 

you^re 0 ^ 1 ?^ H ?£ U ' r f ab ° V€ the 9 iidesl °pe. ATC doesn't know 
you re an 80 , so they turn you too close. Should have a 

different designation of an -80 with ATC. * 



<1 


* Note: 


this fact was mentioned by severs 
true at the time. ATC has since 
and carries an MD-80 designation 


1 pilots, and it was 
changed its procedure 
on its flight strips. 
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Fat ig lip 

"no difference" (2) 

"slightly less" (3) 
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"far less" 

"I'm not used to sitting for three hours" 
Less, but probably due to fewer landings 
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If you could have one motfi JLi££.e sd equipment In the . - Bfl* Mhad 
would you 

Groundspeed readout (4) 

HUD 

Aural altitude warning (like -50) 

?DCS (performance data computer system) (4) 

Rearview mirror to see wingtip lights 
Direct ARINC link to update weather 
Illumination of V-speed card 
Pencil holder 
ACARS 

Nothing (2) 

Strobe lights 

Would rather standardize our whole DC-9 fleet 
Angle of attack indicator 
Remove DFGS and put in -50 avionics 
Long range navigation system (5)* 


* Includes RNAV, Omega or INS. One pilot commented, "it would 
have to be cheap - I'm using Center's computer right now at no 
cost. I can get MSP direct Hector (VOR east of Los Angeles) 
about half the time." 
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■HAJ£E TMQ interview 

■Hltf did you bid the Dr-Q-ftfl? 

Brand new plane. I like automatic systems. 
Pride 

t Schedule I was a bottom block holder. 

1 ' The long legs 



c 


fi finera I s o a menti? about idle und au^m^i^ 

Contemporary plane - I missed it when I went back to the -30. 
complicated. overwbe * m * n 9 - I l».t snap it off when things get 

?h? c m T < ?!l pit ? h chail ? e in descent, esp. in wind changes. Due to 
this I d go to vertical speed and control with wheel. * 

Many electrical glitches that self correct. 

If you don't fly the -80 regularly, you get behind the eight ball 

pressur ization^ont r ol sK 7 3/0 j" B^ii^h^t^ T 

-80? iS\he° Joop a?l S the''??me! Uld 9et the ATIS ‘ ln the 

It's not worth the money (5) 
configuration. 

the e t op°plane? ° £ RepUblic ' 5 comparison. The -80 is 

Totally impressed by the plane. No problems, even out of SNA. 

f Ivina * Sf* ^ration plane. it requires a new philosophy of 
^ 0 -wh “ With ° lder DC " 9s) are underestimated -- 

plane Y ° U haVe t0 st,iy in touch Wlth the 

should . t .V!??* 1S th ? FMA * Now that we have a simulator, we 
with^LOFT ) There V ?c* a <* ecominends m °re simulator instruction 
G/A l IL ■ dangerous sense of detachment, e.g. auto 

a CSS, o“?t ?easJ U ! -Soa?d" S ^ tiC airplane w °cld Uke 

c least a board you can get your hands on. 

At my age DFGS is a problem. Wish the company hadn't bought U. 
First six months it was like flying a pinball machine. Computers 


Could get by with the -50 
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couldn't take (power) interruption. Use external power at ramp 
and things would go black. If you lost external power and 
started on APU or battery, you'd lose the computers. Got a F/D 
flag on captain's side all the way to PHX, landed and the F/D 
came back on. * 

Job is becoming too much button pushing. Company shouldn't tell 
us when to use it — should be our choice. I want my job to be 
more interesting. 

On climbout, everything (DFGS) went blank. Switched to other 
computer (DFGC) and got nothing. Later it came on. 

Older captains have trouble learning DFGS, speed control, 
difference between spd/M and A/P pitch to control speed. 

Took me 150-200 hours to feel comfortable. If anything comes up, 
I want it (automation) off. 

We spend toe much time (looking) in the cockpit. I want one man 
looking out, esp. at SNA. Can't be fooling with DFGS in a high 
density area. 

-80 is a wel) designed machine. If mistakes are made, it should 
be in the first 100 ho-rs. Two new people flying together spend 
too much time programming. The simulator will be a big help. 

I've ridden in back. Good, quiet ride. Passenger comments are 
good. Had a highly experienced passenger tell me that business 
coach in our -80 is the best ride available. 

ATC is changing its mind more and more. It's a bigger problem 
in the -80 than the -50... all your programming goes out the 
window. So I click it off. If I'm out far enough, I try to 
reprogram. 

With automation, you have to stay ahead, esp- G/A and missed 
approach. 

I Iovp the -80 — it had gremlins running around in it. At MKE 
on a cold morning, no FMA, no A/P. Come on when we warmed up. 
Had trouble in cold weather. The -80 compared to a generic is 
like a Cadillac compared to a Model T. 

Occasional crossed hands. Captain as PNF (pilot not flying) 
setting altitude, while F/O is PF (pilot flying) sets the speed 
bug . 

Big variation in captains' ability to handle automation. 

* Corrected in later models of the DFGC. 
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Confusion between heading and altitude when the numbers were the 
same (due to digital display). 

In automation you're out of the loop. In hand flying, you know 
what is happening. 

Programming is simple, once you understand it, but paying 
attention to what you have programmed is time-consuming. 


What do you like About the plane? 

More stable 
Quiet cockpit (3) 

"Gadget ry" 

Radios (esp. twin heads) (11) ; individual vol. controls 
Ability to program ahead 

Digital fuel display (3); "gives you all the information — 
much better than the needles" 

Backup ADI and altimeter 

Radio altimeter design (5); "minimums" voice message 
EPR bugs and preprogramming; esp. for power reduction at SNA 
Both DMEs on same instrument - "I don't like to look around 
cockpit" 

Autobrake (7) ; esp. BUR R/W 07 after rain storm; esp. at SNA 
Automation in general (4); esp. in terminal area or step climb 
Power and performance (7); esp. 8R out of PHX with full load; 
can take off DEN at 100 degrees F with full load; can use 
north R/W at PHX. 

Quick zeroing of digital fuel display 
Self test of slats 
No uplatch check (gear) 

Digital readouts in general, except when they go black 

Test of radar altimeter 

Standby airspeed indicator 

Color radar 

Pressurization 

Large F/D 

TCI 

Test lights 
TAS readout 

General layout of cockpit 
Autothrottle (3); "down to the knot" 

Coupled approach 
Fuel economy 

Ability of F/O to couple \/P 

Versatility of DFGS — ability to use some or all (2) 

D gital ADF 

Back angle select 

Vertical speed very accurate 

Strobes 


66 





y w v 


iifi Y QU dislike about the plane. 

-&&e changed? 


At Mhal Jtffiuld XOU like ip 


Dl9it 0* <S> ' " With needleB Y0U can catch some thing out 

Radar altimeter takes too long to set (3) 

Cockpit lighting, esp. on V-speed book (6) 

Aural feedthrough on ADF ident and VOR ident 

None (so stated) 

Too sensitive to engine ice 

Entire logic of DFGS doesn't take wind into account, then over- 
corrects. Likewise on glideslope with gear and flap 
changes r 

Radio altimeter limited to 500 feet; some non-precision 
approaches have MDA over 500 (2) 

Trouble setting ZFW 

Flap-stab-CG computer too complicated 

w^Tnhl? r -^ t - 0n i’“ sbould use Boein 9 system to set altitude 

W 9h ie?Sht Uni !: eadout ~ should have separate counters for gross 
weight and fuel weight * 

Crew bags shouldn't rest against circuit breaker panel. Need a 
place for bags. A bag can hide a popped circuit breaker. 

No place to put pencils. In the generic DC-9s, should stick it 
be .ween the glare shield and the side. Nc place in -80. 

LedV the h pedestai ead ° UtS 0n ^ pane1 ' but P ut the control back on 


Autopilot (A/P) 

Only time it failed to capture was when we did something wrong 

S ?U e f a l mentions of problem of touching pitch wheel killing 
altitude capture ’ 

P/D approaches^ 76 c0 "' pared t0 - 50 ' to work harder to fly 


Too many problems failures that can usually be reset by 
pulling circuit breakers. Ground school didn't teach us to cope 

DFGS is marvelous cnee you learn to use it. Could fly MSP-LAX 
and never touch the airplane (primary controls). Never had 

'TfV ca “ sed * Can>t fl y ATC now without an 
a/p I m an autopilot freak" 


It tends to pitch up when y 
vertical speed fast enough, 
engagement. 


ou engage at 300 feet. If you 
no problem. No problem after 


reduce 


Difficult to set 
approach of 4700 


100 foot level in altitud 
on BUF SID, 3100' on THX 


e select, 
visual . 


e.g. initial 
Could 
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actually change 1000' while trying to set 100' 

Altitude arm doesn't always stay in deter t... can fall to adjacent 
altitude 

In moderate turbulence, A/P shakes off. Takes very little 
turbulence to disconnect it 


AutQthrot.fi S system (ATS) 

Generally favorable comments ( 4 ); surprised how accurate it is 
at cruise* use it all the time — - big improvement 

Had to learn how to set it on descent 

A/T surge is a problem. IAS hold is not always smooth 

Great for flying around thunderstorm and holding airspeed. Biq 
relief of workload 

Didn't realize how good the A/T was till I went back to the - 
30... it's excellent on the -80 

We don't monitor it enough. I'm concerned that it will clamp 
short of takeoff power 


Ha yau UJsLe ihe coupled a pproach sm the tls? 

It "right's itself" too much on capture. I've had it fly through 
LOC and not capture 

Ok in good weather. I hand fly so I don't get spoiled. Fails to 
capture LOC maybe 1 in 20 or 30 tries. Only once on glideslope. 

I like the preselect it makes a smooth pitch maneuver even at 
3000 fpm. 

Very favorable. Sometimes a new captain would right up the A/P 
wnen the problem was too severe a capture angle (on LOC). Good 
glideslope tracking, even if you capture too high 

Generally f avorable . . . use it 25% of the time. On short approach 
you don't have time. Big adjustment in -80 is to get it down in 
time 

Use it all the time. Gives me more time to look out the window. 
Airport congestion is the big problem with a two— man crew 

Captures and tracks very smoothly ... better than I can do it. I 
use it always, unless I know tne ILS is unstable, like at LAS. 



nag automation _QH Visuai appEQac hg S 
Prefer to hand fly with raw data 

At first didn't use automation, but now use it all the time. 
Beautiful for approach to PHX 

In IMC, ATC sets you up for using it; in visual, you don't have 
time 

rgnt-ral aural system (C A H Sl * 

Generally favorable (4) 

A few warnings are unnecessary, and confusing at first 
Toe loud and overwhelmed with warnings (2) 

Fire test can be heard by passengers 
Objections to "SPEED BRAKE" on touchdown (4) 

"SINK RATE" too loud 
"MINIMUMS" too loud (2) 

Likt ^ configuration warnings (3); "tells you exactly what's wrong" 
lood safeguard, but too sensitive 

Too much talking if there’s an emergency, e.g. "ALTITUDE" warning 
on ILS when captain's talking. But it's better than beeps and 
cones. The lady pinpoints the mode and tells you what the 
problem is. You don't have to remember the modes that trigger 
it, e.g. parking brake set at takeoff 

Likes "OVERSPEED" warning 

Dislikes use of woman's voice on CAWS messages 

Too much voice warning (3); if it's a real problem, could be a 
hindrance, e.g. "minimums" on radar altimeter is a distraction. 
PNF and plane are both yelling "minimums" 

Should only annunciate abnormal conditions 

Likes 210 speed for gear warning 

Dislikes 210 kts.. .should be lower 

* See first footnote page 47. 
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other warning And alerting A y stem s 

Misses having aural tone on altitude alert (8); you need it more 
in -80 than other planes since you rely on automation more; 
possible altitude bust at a busy time — taking ATIS, briefing on 
approach plates; should be consistent with other DC- 9s 

Likes the altitude light (in place of tone) 

Too many aural and visual warnings 

Blue lights (A/P-1, A/P-2, F/D etc) too inconspicuous 

I get warnings due to staying ahead* .. try ing to be more efficient 
by staying high longer 

Difficult to set altitude alert by 100’. As you release it, it 
changes, esp. when done from captain's seat 

Autobrake system 

Favorable view (6); esp. SNA; top feature — I use it every time 
Note: all comments on autobrake very highly favorable 


niai-a-f lap And stab setting computer 

Loading is critical. If incorrectly loaded, fuel burn goes up. 
Had a 2800 pound overburn MSP-PHX 

CG computer is Mickey Mouse. Pointers don't line up. It's more 
work 

Hard to seat flap handle at 20 degree dial-a-flap 

They would have done as well to put in a 20 degree fixed detent 

PrAssnr i 2 ation control -- no comments Wave Two 


Potential JLqas nt 


due .to automation 


No problems when I went back and took a proficiency check (PC) in 
a -10 or -30 simulator (9) 

PC in the -30 simulator a little rusty 

Best PC (-30 simulator) I've ever flown 
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• -i om hut could be offset by hand flying 

Recognized potential probl * with n0 n-precision approaches (to 

(2), we get enough etpetience with^non ^ ^ wtather> ot at 

the P end 0 of C a"fng ! day!i.o y thetv.ise like to do some hand flying 


Can lose Piofi= len ^ j^°i e OV 4'rtt! Ut riUriUd H ! P haS E become" 
“soft" ' whe^A/P^f ailed and I had to hand fly PHX-ORD 


No problem, esp 


if you hand fly something like an ADF approach 


So problems going back and forth from -80 to generic 


4iv * 

. oe fivina the -80, but regained it in one 
Definite scan pattern loss flying tne 

trip in a generic 


Note: the following c °™*^ s in g P ^ s ^^ after 

occurred to LAS crews fol 9 There 9 is no t a corresponding 

a considerable time on the -80. Th« ere^is n^ separate status 

section in the Wave d m0 g t -so pilots regularly flew 

did not exist at that time, and most done backward 

transition°agreed b that it was no problem^ Q^cur re^was'quickly 

f^iSir^ ^nS'tr/ui/^t^ol-e. OC-8S. 


I was spoiled. But fc bbi Vwould^ever like^he^BO more than 
atmosphere. I don t d become less. The emphasis in 
the -30, though the workload had become flying to 

-80 automation is in the wron< 3 9 b lero 
altitude, tracking station is not the k robiem 


-r -fuff * I was on the -80 long enough to learn 

I missed the fancy ^-uff • ld have liked reorientation 

to trust it (500 hours). I “ t on a -10 and flaw a 

training in the generic. I wen gh rate sta tus in the -80 

la™™” ,s. -• »• •* 


r^ar-aARiss 2%. %s2fu aw** 

I relied on automation too much in the 


yjnrkload £Ild 

Less workload - it does so much for you 


LC OO — ~ 

,, aH n) . , t first more. .. simulator would nave 
Slightly less workload (3), at am 

helped shorten this period. 


Less workload, but not as much (less) as Douglas says 


Bt 
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No reduction in workload 


Took 150 hours to get comfortable, but once you’re used to -8G, 
there is more time to look out 

A little less on long legs, but more on short legs 

All told, more workload, but automation smooths the peaks and 
valleys 

More time with head in the cockpit 

No reduction of workload, due to increased monitoring demand 

Preprogramming allows you to avoid high workload, e.g, BUR. But 
workload can be higher, e.g. ATIS tells you the runway, ther. you 
get a sidestep 

Workload is higher for the F/O on the ground — CG, stab etc. 

Not for captain. This is a critical time: checking fuel, 

preparing for pushback. (Suggests putting fuel check earlier on 
checklist) 

Less fatigue in -80 (3); but may be due to easier trips (1) 



-R£lJL£J._£_&x 


Note: no comparable section in Wave One. 


Favorable view of separate status (5); should have been that 
way from the beginning; never should have treated it as just 
another DC-9; company tried to "lov.-key" differences -- we need 
continual training on differences 


Comments on inadequacy of differences training (4); CSS needed; 
"difference class a waste of time — color slides don't do it"; 
Training is "much too light". I had trouble grasping DFGS. 

Needed some hands-on experience. Even a CPT would help. Too 
much talking about it. Even sitting in the plane would help. 

Would like a 60 day proficiency rule in -80 (in place of 90 days) 

Objects to company insistence tnat automation be used ail the 
t ime 


15 degree flap on taxi — not enough time to lower flaps for 
takeoff. Have to "lead" it, esp. at SNA R/Ws only 100' 
apart, and you get rusned. (2) 

I don't think the company uses the A/P to full advantage; e.g., 
taking off in heading select — could take off in heading hold. 






Would have been easier with simulator. Our pilots, especially 
Vietnam era pilots, are excellent 

First 2-4 trips were awkward. The CSS at Douglas didn't work. 

A -80 simulator would make a lot of difference, especially with 
visual capability. 

It takes 2-3 trips to get comfortable, but I lost this when I 
didn't fly the -80. I forgot little things. 


if you could one more piece e q ui pmen t Id the -80. what 

jtfuild y.ou MAnXJ 

Ground speed readout (3) 

Separate heading bugs (controls) (2) 

Mirror to see the wingtip 
Long range navigation (2) * 

Collision avoidance system (CAS) 

Nothing - don't see the need for a. PDCS...we didn't use it in the 
Boeing. No ner*d for Omega, given the fact that ATC will 
with you on a vector but won't give you Omega direct 
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DISCUSSION 


2he Opportunities And Hazards &£ £iald studies 

No field study is ever fully .‘representative of the industry 
The airlines are all different, and the pilots who have Y * 

transitioned into the -80 at other airlines differ in many wavs 
from those at Republic. For example, most of the DC-9-80 Y Y 
operators have transitioned crews from aircraft ocher than DC-9s- 
from 727s at PSA, 737s at Air Cal, and from a varied of aircraft 
at two trunx carriers that have obtained the -80, TWA and 
American. Thus, other carriers have transitioned flight crews 
from Boeing to McDonnell-Douglas products, and in mos? cases (Air 
Cal being one exception) from three-person t** two-person 
cockprts. At the two trunk carriers mentioned, soSe o? the 
pilots may have had prior experience with sophisticated flight- 

firsts for example, gur.ior captains who had fl^'as 

first officers in ?47s f or in DOlOs (AA) or L-lOlls (TWA). 

nr-a_fin PUbAiC P roba ^ 1 i r represents the "purest" case — all of its 
C- 9- 80 crews came directly from older models of the DC-9 (-10, 

Tk° model fJ* Most were highly experienced DC-9 pilots, 
and with the possible exception of military flying, were 
encountering modern automatic systems for the first time. 

Furthermore, an airline operation is not a pristine 
laboratory, far from it, especially in the period following the 

A u fc of . 1978 ' and the economic hardships that 
tollowed. In the harsh environment of deregulation, high fuel 
prices, ^and high interest rates, this study became "event 
driven." As soon as the project began, economic factors made it 
necessary for Repubiic to delay its acquisition of the Super 80s, 
caking only three in 1981 and three more in December of 1982. 

This impacted the study by making it somewhat difficult to build 
° f Participants. Many of the roughly 100 Minneapolis 
p ot., who initially went through the differences school had no 
opportunity to fly the -80 after their training, and many who did 
clew mixed blocks with a majority of their time being in older 
models. Several of the pilots who originally volunteered for the 
panel never flew the -80, and hence did not fill out question- 
U“ es ,°u participate in the interviews. The Las Vegas panel was 
more stable, due to the imposition of the "separate status" rule 
in September 1983 (see Page 85. and Page 96. Paragraph. iiost 

^-,v h w^h W ^K bld a ? d Were trained for -80 operations tended to 
¥ e airplane, until just prior to the closino of th^ 

Las Vegas domicile in August 1984. 

At the same time, the over abundance of -80 qualified pilots 
m Minneapolis provided an opportunity to look into the matter of 

^he W -ame 7 innt-h° th the ° ldeC models and the automated -80 during 
; e t - e 0 th \ even ? n SOme P airin 9 s the same day. Also, manv 
of tne pilots who qualified in the -80 bid otner blocks, and tnen 
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bid only occasional trips in the -80, and many fell out of 
qualification (three months) and had to be requalifxed, to the 
concern of management. Again, this offered an opportunity to 
gain some insight into the question of skill maintenance in a new 
aircraft. So the economic hardships that delayed the delivery of 
the aircraft provided both difficulties and opportunities for the 
study- Also, for the reasons stated above, this study -id not 
turn out to be purely longitudinal, but more a mixture of 
longitudinal and cross-sectional techniques, since there was some 
change of panel members from the first to the second wave, 
particularly in Minneapolis. 

211. ol OpiniQD 

Line pilots often express the sentiment that their opinions 
and experience are under-represented in the design and 
certification of the craft they fly. M 5 8 i K fe ;i*kat aircraft 
manufacturers, in their design work, and the FAA in their 
certification, do not make sufficient use of the experience of 
line pilots. They further protest that when airline pilot input 
is sought, it comes from management pilots, ranking officials o 
the flightdeck unions, and others whom they perceive (rightly or 
wrongly) as remote from the every day rigors of line flying* 
Whether this view is correct or not, or possibly correct but 
exaggerated, is not the issue. The sentiment is mentioned here 

for two reasons. 

First, it is not only appropriate, but necessary to remark 
on the motivation of volunteers in any study. It became very 
clear in the interviews that the pilots volunteered lar^e ^ 
because they felt that participation in the study wou. allow 
them, in some small way, to influence future air -*°P ration 
and certification . This feeling was engenders oy the invocation 
which was distributed to the pilots asxir* them to 30i.* the study, 
and by the chairman of the union Safely Committee. In his appeal, 
to the pilots in support of tne :>cudy , he stated (to paraphrase 
as closely as possible), " v cu complain that nobody cares about 
your opinions on cockpic design ~ now here is your chance to be 

hea rd - " 

second reason that pilot opinion is mentioned is that 
aside 'from their complaints that they are under-represented in 
design and certification decisions, crews represent a vast and 
valuable "database" of experience that could be tapped for 
evaluating cockpit design. In a short time after a new aircr-rt 
i j introduced, considerable data are generated, information tnat 
could simply not have been anticipated in the design, testing, 
and certification process. In a very real way, _ine flying 
"shakes down" an airliner and pilot opinion harshly examines the 
soundness of the cockpit design. Thus, it is hoped that the data 
reported here might influence operational and training decisun^, 
certification techniques, future fliahtdeck designs, and 
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development cf principles of automation. Likewise, this study 
may be valuable by dismissing some areas thought to be of 
concern, where the concern is seen to be unjustified. 


However, we must recognize pilot opinions are extremely 
variable. This may indeed affect the degree to which studies of 
this sort may influence future design and training decisions. 
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Overall View sit Automation 

For purposes of this discussion, we shall include not only 
those equipment items which are unquestionably "automation", that 
is those in which previously manual functions were replaced with 
devices or eliroinarcd (e.g. autobrake) , but also those new 
features of the aircraft which were designed to reduce workload 
or add to the versatility. For example, the dual head 
communication receivers are in no way automation, but they do 
reduce manual operations by making it unnecessary for the PNF to 
write down the new frequencies prior to a frequency change. Also, 
changes in instrument design, such as the vertical scale radio 
altimeter, and the digital displays, will be discussed in chis 
report for the same reason. In the mind's eye of the pilots 
interviewed, all of these features are intertwined with 
automation, and they do not bother with distinctions between 
automation and other features of che aircraft. 

Overall, a favorable though mildly skeptical bias toward 
automation emerges from these data. The mean responses on the 
positive items on automation were quite positive (high agreement) 
and likewise there was generally strong disagreement with the 
negatively worded items. For example, the responses to tnree 
essentially negative items (No. 2, 6 and 19) were mildly 
rejected, and those responding to the positive items (No. 8, 9 
and 10) showed a mean indicating acceptance. It is interesting 
that tnose items that linked automation to economic well-being of 
che industry (No. 18 and 20) yielded more negative responses, 
with means near mid-range or slightly below. No. 29 which 
dealt with the safety implication of excessive automation ("Too 
much automation can be dangerous") received near-center means, 
with wide variability. 

Since much of the inteiview data and responses to open-ended 
written probes dealt with specific features, as well as pilot 
workload, these will be discussed under the workload section. 
These results can be summarized broadly by saying that the 
general reaction to the cockpit design was favorable, and was 
most favorable to the "automation" related changes. But there 
was also considerable criticism of specific items that were 
perceived as poorly designed, or increasing workload. Also, 

as mentioned previously, there was no overall endorsement of tr.e 
economic or even the safety impact of automation. As for tne 
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economic argument, it must be recalled that the first wave of 
questionnaires and interviews occurred late in 1982, when the 
economic fortunes of Republic and most other airlines were at an 
all-time low. Wave Two occurred in 1983 in Minneapolis, and 1984 
in Las Vegas, at a time when the economic situation of the 
airline industry was brightening, due to a general upswing in the 
economy, a slight drop in fuel prices, and wage and productivity 
concessions by the airline unions. 

On specific equipment and capabilities, the responses were 
again generally favorable toward automation and specific devices, 
and toward the Super 80 in particular. There seemed to be high 
enthusiasm for the Super 80, as seen in the strong agreements with 
the positive statements (No. 31, 33, 35, and 36) and rejection of 
the negative statement No. 32. Note that Item No. 31 ("I think 
that the -80 is a significant step forward in short and medium 
haul aircraft'*) received the strongest (positive or negative) 
mean rating of all of the 36 items. Again, those items that 
dealt with the operational limits, and hence economic factors and 
impact on the company, received a mixed to generally cool 
reception (No. 22 and 24). 

Further general endorsement of the automation features of 
the -80 can be seen from the f requency-of-use data (Table 4-A and 
B). The mean frequencies indicate an overall acceptance of the 
devices, as well as the company policy that equipment is to be 
used where appropriate. For example, the ATS was showed a mean 
usage of 98-99% on takeoff, and in transition and enroute climb, 
but was used with a mean of only 73-86% of the time in cruise. 

This would indicate a wide acceptance of the value of the ATS at 
the workload-critical portions of a leg, but some unwillingness 
to accept its instabilities at cruise, where the workload is 
minimal . 

Finally, it ii interesting to note the moderately favorable 
attitude tov/ard and lack of concern for equipment reliability 
(No. 25, 26 and 28), especially in view of the ract that the 
early model flight guidance and autothrottle computers had some 
rather negative characteristics which were corrected in later 
models, and several of the interviewees expressed concern over 
equipment reliability and the possibility of sudden inflight 
failures. Several related incidents of what they describee as 
"data dumps" (total shutdowns) of the flight guidance compucers 
after takeoff. 

If one could summarize the pilots' attitudes in one sweeping 
statement, it would be something like this: "I like the 

airplane, I enjoy flying it, I approve of certain features and 
not others, I find a moderate reduction in workload, but I 
seriously question whether the automation positively contributes 
to safety, and I question whether it is a good investment at the 
price." 
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Percei ved Workload and Fatigue 


Terms such as "workload" and "fatigue" are widely used in 
man-machine systems, and are poorly defined, difficult to 
measure, and impossible to predict. For purposes of this report, 
these terms will include whatever the pilots intend them to mean. 
If the pilot refers to the number of times he must twist a knob 
to set the ZFW as "workload," then it is included here. Mental 
workload could include those cases where no overt or observable 
activity takes place, for example planning where to begin descent 
in order to make a crossing restriction, or mentally computing 
actual versus planned fuel burn. 

Since workload reduction was at the hoart of the design and 
certification of the -80, as mentioned in the introduction of 
this report, it will be discussed in some detail. Much of what 
is reported by the pilots in the open-ended probes and the face- 
to-face interviews dealt with their perceptions of the workload 
question, including broad generalities (as also probed in several 
Likert items) , as well as discussion of specific systems and 
equipment items. This section necessarily overlaps with one 
which follows on specific features in the cockpit. 

First, the attitude scales (see Table 3-F) make it clear 
that the pilots express a positive attitude toward the role of 
automation in workload reduction. The strong positive 
endorsement of Items 14, 21, and 27 vouch for this, as well as 
the weak rejection of the negatively worded Item 15, 17, and 23. 
Overall, Item 27 ("Automation reduces overall workload") tells 
the story - a nean of 66 and 70, corresponding to mid-level 
agreement. In the Wave Two results, the standard deviation was 
lower than usual on this question, indicating less divergence of 
opinion. While responses to this item reflect a generally 
favorable view of automation as a workload reducer, when asked in 
interviews to quantify the degree of reduction, the replies 
reflected a perception of modest reductions. 

Comments from the check captains also express a favorable 
view of workload reduction in the -80, though they, like others, 
draw a distinction between the experienced and inexperienced 
pilots. Throughout the interviews, pilots expressed the belief 
that, the first 50 to 100 (some said 150-200) hours on the line in 
the -80 were very difficult, and a considerable amount of time 
was spent trying to understand the automatic systems, monitoring 
and interpreting the FMA messages, and prog rationing the A/P and 
A/T, especially in terminal areas. Many said they had their 
"heads in the cockpit" far too much during that period, but after 
they passed the critical experience level, and became at ease 
with the automation, they noticed a reduction in workload, and 
more time "out the window." More will be said of the initial 
transition period when training is discussed. 
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« Asked to estimate tie workload reduction on the -80 relative 

| to older DC-9s, about 2/1 of the crew members replied "slightly 

less", and the rest were divided between considerably less to no 
j difference. A few reported that they felt that the workload was 

] increased, due to what they perceived as an increases in the 

j monitoring ("scanning") demands. And it was generally recognized 

j that to some extent, the total workload may have been less 

reduced than redistributed, with more subtasks to perform at the 
gate and fewer in the air, which they recognize as a plus for air 
j safety, Several mentioned that "actual" workload had been 

j reduced, but there was an increase in demand for monitoring, a 

] point especially emphasized by the check airmen. 

These last points are consistent with the views advanced by 
Wiener and Curry (1980). A good example is the altitude and 
heading preselect functions of the DFGS, which allow the crew to 
set up for a SID while still at the gate. These, coupled with 
the ability of the A/T to control airspeed during climb, clearly 
reduce the workload during a critical phase of flight, and one in 
I which extra-cockpit scanning during VMC conditions is essential. 

| The favorite example seems to be the MUSEL-4 SID from SNA, with 

j Thermal transition (Figure 4) . This is a complex departure, 

j. coupled with a required noise abatement power reduction at 1000 

t feet, in an area with high VFR traffic and marginal VMC weather 

[ ^ California VFR") . There can be little doubt that the avionics 

[ an< 3 automation of the -SO make execution of this departure easier 

► and safer; how much so is impossible to measure. 

Other features that, in the pilots’ eye, reduce workload 
i include the pressurization control, and the A/T system in 

general, despite earlier complaints about its instability. 

Actually there are probably two classes of workload 
reduction. The first would be those already mentioned, such as 
the altitude and heading preselect, and IAS/Mach hold, devices 
that can be programmed and will then essentially relieve the 
pi-lot of continuous control, anticipation, and capture maneuvers. 
The other category might be called procedure elimination, 
devices in which certain procedural steps required in the earlier 
models are not required, e.g. the automatic pressurization 
control, which eliminates one step, and the dual head 
communication receivers, which eliminate writing down 
frequencies. A frequently mentioned eliminated step is the 
J landing gear uplatch check. While this was not e'iminated by 

i automation, the pilots do not make this distinction. Thev view 

any elimination of steps as workload reducing and view it* 
favorably, especially when, as in the case of the uplatch check, 
the relief comes at a time of perceived heavv workload or 
criticality. 
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There seems to be little agreement on the subject of 
monitoring as a workload item. This is one of the areas where 
the check captains appeared to differ (in interviews) with the 
line crews. The check captains placed heavy emphasis on 
monitoring, especially in keeping a constant check on the FMA 
each time an option is selected or a maneuver (such as altitude 
capture) is entered. The line pilots appeared to be somewhat 
less concerned with monitoring activities, and it is interesting 
note that the Likert item No- 17 ("Automation does not reduce 
workload, since there is more to keep watch over") received a 
weak mean rejection. 

As mentioned previously, most of the crews felt that the -80 
brought only a slight workload reduction. This may be in part 
due to the fact that there were certain features of the -80 
which, in their view, increased workload. In the interviews, 
opinions about these pieces of equipment and features took on 
great importance. Specific features of cockpit equipment will be 
discussed shortly, but for now some of the features that are seen 
as increasing workload should be mentioned. As in the case of 
the perceived workload reducers, some of these are automation 
related, some are not. Most frequently mentioned items are the 
slat/flap handle which is difficult to seat, especially when 
using dial-a-flap options; the necessity to stow the dial-a-flap 
after takeoff, which requires considerable manipulation of the 
dial; and the setup of the stab setting computer (at the gate), 
which is seen as containing unnecessary and even erroneous 
information, since the two readings of CG do not exactly agree, 
ever, when the pointers are precisely aligned. The contra- 
rotating numerical scales (one way for the longitudinal trim 
window, the other way for the CG and flap windows) were 
frequently mentioned as troublesome. 

Certain features ate difficult to describe in their workload 
impact, since they require management, but eliminate certain 
steps, and the net effect is not clear. The best example is the 
autobrake, which is well accepted by the crews, but does add 
checklist items even when not used. In spite of this, the ABS is 
perhaps the single new feature about which the author heard no 
complaints, and Table 4 indicates that it is used on a mean of 
56-63% of the landings. Company policy prohibited its use on 
takeoffs (for braking in case of rejected takeoff). 

In summary, the perceived workload management of the Super 
80 is viewed as a modest improvement over tr.e older DC~9s, but 
probably far less than claimed by the manufacturer. 

Finally, the matter of fatigue was discussed with the crews, 
but yielded little additional information, since they tended to 
see fatigue and workload reduction as the same thing. Likert 
items No. 27 (overall workload reduction) and 30 (overall 
fatigue) got similar mea n ratings (66-70), indi ca ting very 
positive acceptance of positively worded probes, and t he 




\ 



bl 




r 


'V-/ 


were 
garnered 
uisition of 
the extreme 
pilots 

ght segments 
densome. It 
let alone 
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sometimes far 
t fatiguing to 
most of the 


intercorrelations between the ratings in both waves 
statistically significant. The omy new information 
regarding fatigue was a secondary effect of the acq 
the - 80 , 9 the fact that longer legs were being flown 
being MSP-LAX which is about three hours. Several 
commented that they were not accustomed to long fli 
and found "sitting there for three hours to be bur 
is a further comment on the difficulty of defining, 
measuring, fatigue that pilots accustomed to flying 
schedules requiring often eight to ten legs a day , 
more, in and^out of crowded terminal areas, found i 
suddenly be flying fewer, longer legs and spending 
day at cruise. 

Skills Maintenance And £CjOSifiD 

Much has been said and written about the potential for 
automation to induce an erosion of manual flying skills, though 
the author can find no documented evidence for such a P nen ^ non * 
The dramatic term "automation atrophy has been applied. The 
presumption is thc.t pilots flying highly automatic aircraft will 
rely on these devices to the detriment of their flying skills, 
and when faced with the loss of automatic equipment, or 
transit ion to a less automatic plane, find themselves unable to 
do the Job safely, ot to conform to their own standards of 

ra- own 

sMsriu ~ 9 if - a-, 

complacency would be a problem, 


Seme of 


the concern for "automation atrophy" has come from 


i nna-haul carriers, who have noted that senior copilots on 
advanced aircraft, who become ready for captaincy and must pass 
checkr ides in less advanced aircraft, are experiencing 
dif * i cultv. The long-haul aspect seems important, since the., 
oilots hav^ so few opportunities to practice critical maneuvers. 
This is in contrast with DC-9-80 operations, which are primarily 
short-haul (e.g. Hawaiian, PSA. and Air Cal), or medium haul 
(e q Republic east-west routes). The majority of Republi 
trip* pair inqson the -80 call for four legs a day; some call for 

two and seme three. Thus the typical -80 P^^ J^^th^cSstom 
35-40 legs a month, possibly as many as 48. Obeying the 
of trading legs, each pilot could expect to make in the 
neighborhood of 20 takeoffs and landings a .^J 1 ® t 

far less than the experience ot the typical DC 9 pi 
Republic, it is probably sufficient exposure to critical 
maneuvers to quell some of the fears of automation induced sk 
loss. Nonetheless, seme of the concern is based not onl, on a 
paucity of critical maneuvers, as in the long-haul carriers, but 
on simply over-reliance on automation regardless of the number 
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terminal area and other critical operations. For the first two 
years of the -80 operations at Republic, the question was 
somewhat moot, as ?.ll but a handful of very senior captains and 
first officers flew mixed blocks. The -80 time was actually a 
minority of the flying experience. Thus che majority of the 
pilots had ample opportunity to retain their manual skills by 
flying traditional DC-9 aircraft. 

In September 1983, a contractual change created a '-separate 
status" for -80 crews. Under this change, crews would be 
exclusively assigned to the -80 for nine months, and would not be 
allowed to bid trips on traditional DC-9s during that period. 

Thus the skill loss question might have become more of an 
operational reality than it had been during the first two years 
of -80 experience. 

To the extent that the experimental design permitted 
evaluating this question, there has been no indication of a 
problem with -80 pilots suffering skill loss. Prior to the 
separate status rule, there was little opportunity to examine 
skill loss induced by the -80, since nearly all of the pilots 
were also flying the traditional DC-9s. Even after the separate 
status had been in effect for nearly a year, there was no 
indication of an "automation atrophy." 

Check captains reported that the six-month proficiency 
checks, which up until recently were flown in a -10 (PHX) and a 
-30 (MSP) simulator, were highly professional. Few pilots 
expressed any great concern over skill atrophy, as long as they 
continued to hand fly some on every trip, as it was typically 
stated. The check captains reported the same thing - they urged 
newly transitioned pilots to keep up their hand flying skills. 

The caution was hardly needed in the first 100 or so hours of 
flying the -80, as the typical response, reported to the author, 
was that when stress was encountered (e.g. unexpected ATC change 
in a terminal area; runway change; difficult SID) they would 
"click it off." This bears not only on the question of skill 
maintenance, but on skill acquisition as well. It is an 
interesting commentary that pilots so often reverted back to hand 
flying when the unexpected occurred. As one pilot put it, "I 
have never made an automatic go-around before, so when I get a 
go-around I'll do it the way I know how. " (The automatic G/A is 
now a required maneuver in the -60 simulator training.) 

Much of this difficulty in skill acquisition may have been 
induced by the lack of a -80 simulator, and this may nave now 
changed since the arrival of Republic's simulator in May 1983. 
Furthermore, proficiency checks (PCs) for the -80 pilots are now 
flown in the -80 simulator in Atlanta. Soon after the arrival ot 
the simulator, crews showe' some apprehension about flying 
difficult maneuv r z, such as engine outs, in the -80 on PCs, and 
the company decic^d to allow pilots scheduled for their six-month 
PC to take a "tree ride" the day before in order to practice 
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maneuvers. This did much to allay their fears, and in addition 
was found by the simulator instructors to be a valuable training 
opportunity. 

The response to Likert item No. 3 ("I am concerned about a 
possible loss of my flying skills with too much automation”) 
received a mean response near dead-center in both waves, with a 
large standard deviation, indicating a wide range of responses 
from deep concern to no concern. 

Concerning ground school methods, many crew members 
expressed a disappointment in their differences classes, and a 
feeling that they went into their initial operating experience 
(IOE) unprepared. Republic's ground school instructors made a 
genuine effort to make the most of the two days in the classroom 
to teach the -BO differences, and had added a "static airplane" 
session at night following the classroom periods. The static 
airplane consisted of an instructor and two students in the cock- 
pit, with electrical power on the airplane, offering instruction 
in what they referred to as the "knobology," meaning essential ry 
the location and actuation of the controls and switches. As a 
training device, the aircraft on the ground is extremely limited, 
as most of the crew actions would be non-interactive. The 
instructors did the best that could be done with the materials at 
hand, but were hampered by the obvious lack of a -80 simulator, 
as well as adequate (interactive) classroom training devices. 

The flight guidance system and ATS of -80 do not lend 
themselves to static classroom training devices or media, of 
which slide/audio lectures are the most common. These are 
provided by Douglas for their customers, and may be as well 
executed as static training aids can be. But the main 
differences of the -80 are not the traditional systems (fuel, 
electrical, hvdraulic etc.) which are suited to slide/audio 
presentation quite well, but the dynamics of the DFGS and ATS, 
which are not. What seems to be needed is higher quality, 
dynamic training devices, both for classroom instruction and 
auto-instruction. Microprocessor ano high-resolution color 
displays are now within a reasonable price range, as well as 
interactive video disks, and other digitally based instructional 
devices. There appears to be a wide gulf in training devices 
between the elaborate high-fidelity (and high-cost) simulator at 
one end, and the slide show, paper trainer, and static clessroom 
mockups at the other. Clearly there is a need for a resec :ch and 
development effort directed toward training devices and 
techniaues to fill tms gap. 
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System 


Attitude questionnaires show surprisingly little concern 
over the reliability of the automatic system in the -30. The 
three sterns (No. 25, 26, 28) dealing with reliability show a weak 
mean rejection of the negative statements, and a weak mean 
acceptance of the positive statement ("The new equipment is more 
reliable than the old"). 


Most of the concern centered around the digital flight 
guidance computer, and the A/T system. Most of those interviewed 
expressed some concern because they could relate at least one 
instance where the systems had failed to perform as expected. 

For example, many reported failure to capture a preselected 
altitude in climb or descent (the author observed one instance in 
a c^imb), failure to roll out on a preselected heading, or 
failure to capture a VOR or LOC beam. There was little complaint 
about glideslope tracking on an ILS, except the usual concern 
over porpoising, which seems to be an attribute of ground 
transmitters more than the on— board equipment. 


-.i.rJfS b i???/S 0Ut ? i ^ cra f t ,f ailing t0 ca P ture Of departing from 
selected altitudes at level flight are harder to explain, it is 

worth noting that the at the time of this writing, the Aviation 
Safety Reporting Systems (ASRS) has been receiving numerous 
incidents involving failure to capture altitudes from DC-9-80 
crews. There is a very good chance that the departure was 
induced not by equipment failure, but by inadvertent actuation 
of the vertical speed knob, or even by a lack of understanding of 
its function. Several check captains reported that the trainees 
did not understand that once the preselected altitude capture had 
been annunciated in the FMA but prior to actual level-off, 
movement of the vertical speed wheel would cancel the capture and 
initiate vertical movement. 
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Many of the negative comments about the flight guidance 
system were due to conditions that were corrected by the 
manufacturer in later models uf the flight guidance computer. 
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speed wheel, the nature of the capture maneuver, and the role of 
the FMA messages when initiating a control selection or setup 
change. This illustrates only too well the importance of 
monitoring the FMA, a concern that appears frequently in 
interviews with check captains. Part of the problem may be that 
the changes in mode annunciation on tne FMA are silent. Thus, 
capture can be cancelled, and very easily missed by the crews. 
Some pilots have recommended that an auditory alert be sounded 
whenever capture is cancelled. Others nave recommended a more 
radical design change that would not allow a capture to be 
cancelled except by setting a new target altitude. Inadvertent 
cancellation of an altitude capture may be a problem that rnay 
vanish or at least be diminished as a result of increased -80 
simulator training. 

Much is said about the "unreliability’ of the A/T system. 

The problem as described, and as pointed out to the author 
repeatedly in the cockpit, is probably not one of reliauility — 
the system rarely fails — but of proper setting of gains. The 
904 computer did much to relieve the instability problems, and 
later models such as the 907 and the 920 have resulted in steady 
improvement s. Although the ATS instability was the target of 
much criticism, many pilots reported that the ATS was the feature 
of the -80 they liked the most, mainly its ability to control 
airspeed in climbout in a crowded terminal area and thus to 
relieve the pilots from monitoring airspeed. They seemed willing 
to live v/ith the instabilities, since they could manage throttle 
control at cruise simply by allowing the ATS to set EPR to 
establish cruise Mach, and then turning the ATS off. This 
use of the equipment is consistent with the Wiener-Curry 
principles (Appendix 1) regarding designing automation to allow 
varieties of pilot options and styles. 


Specific 

Interviews and open-ended questionnaire items yielded 
valuable pilot opinion regarding not only automatic devices, but 
other cockpit features. Some of these are covered in great detail 
in Table 5, and in Section VI. Especially illuminating are the 
responses to the questions on what the pilots like most and least 
about the -80, compared to previous models of the DC-9. Let us 
examine just a few items, as they bear on the pilots' acceptance 
of the aircraft, and their perception of the workload level. 

Many of the comments concerned what human factors engineers 
call control/display ratio, which is the number of units (usually 
linear or rotational) that a control must be moved per unit 
movement of the display. A low C/D ratio is a "sensitive'* 
control. If it is too low, overshoot followed by fine-grain 
adjustment near the target value, result. I r. it is too hunt, 
excess course-grain actuation is required, winch wa. ; tne 
complaint here. There were frequent complaints about tne C/D 


being that it takes too many turns to chana^th th * co “ plaint 
zero to 200 feet (the most frequSSt DH? h ?h* ? e i.S ettin ? from 
recently, and found that the C/D ratio was 1 ^ ' U out 

a nuisance, and as such contributii/fn*^' bUt the pilots find it 
perception of workload? contributes ln some part to their 

(espLtltl^stowtnr^rm *?? settin 9- and the 
One cannot say without some Lsearch 9 wh?? "® ntloned previously). 
®ight be for these various inlt??m^i-? h the optimal C/D ratio 

safety or operations? iS th! ihiulS'ni? J fc « itical to 

trivial if pilots are suff i^is»r,«-? Ue should not be dismissed as 

bring it up repeatedly in this st udv""*]!^ ■ ? y • fci9h C/D ratios to 
small annoyance in the cockDit t:>e ver V sort of 

line pilots' opinions are not sought 1 and coulS* sentiment that 
desxgn errors. Consistent with thie* an ? f ould Prevent such 
ratio on the CDI needle settina anH\h ll ° t8 praised the low c/D 
fuel counters to the zeroina hufr^n** * the lnstan t response of the 
analog gauges, which required that- a. K as c ? n tr as t*id with older 
needles we?e driven to zero? 1L SWlt ' h be held unfc il the 
pilots are lazy, but onl? that fSJ ArX® n0t infer that 

that obtain the desired settina rani^n? fer sen ? ltlV€ controls 
overshoot is not a sMioIl SlJteJ K Si esp f ciall y »ince 
above. High C/D ratios . n instruments mentioned 

that even fractional second delavs^ar^ 0 * th€ ? ilot in t * le same way 

terminal operators. The delays «e ?riv?2?T n9 co "P ut « 

but loom large in the minds of those 
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of course that information is available from the FMA (see Figure 
6). Generally a pilot would like to have information available 
*t the source: a self-illuminating button allows a control to be 

also a display. On the other hand, one could imagine a design 

b * hind the non-self-indicating buttons that says that 
** the proper place to receive the information* and 
nothing should be allowed to be a substitute for FMA scanning. 

The author does not take sides in this. It seems a good 
researchable "knobology" question, and besides, it is not cleat 
whether the self-illuminating switch was ever considered and 
rejected for the philosophical reason stated speculatively above, 
or simply was not considered. 1 


In summary, it appears that in the view of the flight crews 
participating in this study, the generally excellent cockpic 

J he “®° is ®arred . somewhat by minor design errors which 
the crews find annoying. This may be inevitable, since there is 
seldom unanimity on design features. For example, the pilots 
interviewed were about evenly split on the absence in the -80 of 
an aural tone on the altitude alerter. At 750 feet, prior *•© a 
preselected altitude, an amber light illuminates on the 
altimeter, and extinguishes at 250 feet prior. Older model', of 
the DC- 9 have a wide variety of altitude alerting devices and a 
trigger points, but all include some form of a>J ! ;al 
warning. About half the pilots said good riddance, the tone was 
just one more annoyance in the cockpit. The ether half felt that 

" b V 8ts " w *? e * ore likely with no aural reminder (except 
the CAWS voice warning After a 300 foot excursion) . Even the 
check captains wore divided on this issue, showing, if nothing 
else, that even pilots steeped in standardization are not a 
monolith. One c*n standardize procedures, but never pilot 
opinion. What is still not clear to the author is why 750 feet 
was chosen by the designer as the trigger point, in view of the 
customary 1000-to-go vocal callout from the PNF to the PF. 

Eaycho- social Factors 


_ M *? y *? thors in the auton,at ion world, including Wiener and 
Curry (1980), have expressed concern (though have offered no 
evidence) that pilots in highly automated aircraft may some day 
surfer some sense of detachment or alienation from the flying 
job, e» ** r.dered by a feeling that the job has become one of 
pushirg outtons and not flying planes. To the knowledge of the 
author, the question has never been explored. The attitude 
scale items in Tables 2-A and 2-B offer a mixed picture- Scale 
Item 1 ("Flying today is more challenging than ever") received 
mild mean agreement (62) in both waves, but a large standard 
deviation so apparently there is rather varied opinion on this 
matter. Item 6 ("I think they've gone too far with automation") 
got a strong rejection, and Items 9 and 10, regarding looking 
forward to more automation in the future, received mixed 
opinions in both waves. 


9'J 


In the interviews the author detected no psycho-social 
synptoms such as job disenchantment* loss of self-esteem* or 
sense of detachment. None of the psycho-social items correlated 
significantly with total time (presumably a reflection of pilot 
age). Although there was talk of "being out of the loop"* and 
references to automation as "Ataris" and "Pac-Man"* this should 
be viewed as a minor frustration over adjusting to a new style of 
flight* and not a sign of deep-seated distress. In summary* the 
author encountered nothing in this study to war rent concern for 
psychological disenchantment with flying as a profession as a 
result of the advance of automation. 
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VIII. CONCLUSIONS 


1. The DC-9-80 and its flight guidance system and other 
automatic features are generally viewed by the pilots who fly it 
as well conceived and well designed. While there are many 
features that are questioned and criticized by the crews, overall 
they hold the plane in high regard, and view it as a modern 
aircraft. Many questioned the economic value of the automation 
in the -80, and a few expressed the belief that in view of the 
economic conditions in the airline industry, they would have 
preferred that the -80 have the improved wing, the -217 engines, 
but essentially -50 avionics. 

2. Crews generally responded favorably to abstract questions 
about flightdeck automation (aircraft type and model 
independent) , but viewed increasing degrees of automation with 
mixtures of approval and apprehension. The overall view of 
automation was favorable, but many expressed concern about the 
pilot being "out of the loop," or "along for the ride." Many of 
the crew members, including the most enthusiastic, voiced a 
concern over the increasing degree of monitoring ("scanning") 
required by automatic equipment. Although pilot age was not a 
variable that was directly examined in the study^ the interviews 
left the impression of at least a weak relationship between pilot 
age and acceptance of automation. Some of the senior captains 
were the most skeptical of the value and safety of increasing 
degrees of flightdeck automation, and the younger first officers 
tended to be the most enthusiastic. However, many of the older 
captains were strong supporters of increasing automation, and of 
the -80 avionics and flight guidance systems in particular. It 
is worthy of note that two captains reached mandatory retirement 
age (60) during the study, meaning that they had bid the -80 with 
only about two years left in their career. Both expressed the 
sentiment that they wanted to fly the most modern aircraft that 
they could before retirement. 

3. There was overall a high usage of the automatic features, 
though the data indicated great variations in usage by 
individuals. The company policy which the crews call "we bought 
it, you use it" was questioned by many. A substantial number of 
pilots, particularly captains, felt that the automation should be 
provided by the company, but that it should be left to each 
individual to determine when and under what conditions he would 
choose to use or not use the automatic features. Many of the 
younger pilots were strongly supportive of the company policy. 

It is difficult to determine whether the less-than-total 
conformity to the company policy was based on skepticism about 
the automatic features and their reliability and functioning, or 
traditional pilots' insistence on their right to choose their own 
style of flignt. Although company policy is outside of the scope 
of this report, the author notes that (1) the use of automatic 
devices may b«. more difficult to standardize that other cockpit 
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procedures; and (2) the Wiener-Curry principles (See Appendix 1) 
stress leaving the choice of automation to the pilot. Obviously 
this is a difficult question, which will require further line 
experience, and examination by researchers and flight managers. 

4. During the initial period of this study, there was 
considerable concern voiced for the reliability of the automatic 
equipment, but by the second wave of data collection, which ended 
in August 1984, this concern had diminished. This was partly due 
to improvements in the equipment itself, for example, by that 
time a third generation of flight guidance computer (904) had 
been installed, and many of the previous problems had been 
eliminated. Also crews’ initial apprehension about equipment 
reliability had diminished, and many came to realize that what 
they had initially viewed as equipment failures were actually 
crew errors in operation cf the flight guidance system. By the 
end of the study, most crews felt that the equipment was highly 
reliable, and expressed only the concern that it required a 
degree of monitoring that was beyond what they had been 
accustomed to in the earlier DC-9s. 

5. On the subject of workload reduction, there were mixed 
reviews, as the previous sections reveal. The attitude questions 
dealing with workload show an overall positive view, but in 
interviews the crews expressed the opinion that the workload 
reduction overall was slight, especially when "mental" 
("cognitive") workload was taken into account, as well as the 
increased demand for monitoring. A consensus was that if one had 
to place a number on workload reduction, it would be around 15 
per cent, far short of the expectations for the -80. 

Specific pieces of equipment and certain procedures were 
seen as workload-increasing, for example the stab trim and CG 
procedure was viewed by the first officers as high workload 
items. Likewise for the operation of the dial-a-flap, especially 
in view of the perceived difficulty in seating the flap handle in 
the selected detent position, and the need to stow it after 
takeoff, which required a considerable number of turns of a 
rotary control. Individual features and design parameters were 
also criticized as workload increasing. For example, many crews 
were critical of the high control-display ratios (lack of 
sensitivity) in setting parameters such as the zero fuel weight, 
and the minimums on the radio altimeter, both rotary controls. 
Some of the strongest praise in connection with workload 
reduction was directed toward equipment that could net be 
described as automation, mostly notably the dual-head com radios. 
Nearly all pilots commented on the reduction in workload through 
the elimination of the need to write down communications 
f requencies. 

There was considerable recognition of the fact that although 
workload may not have been reduced much overall, it was 
redistributed in a manner that allowed certain operations to be 
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performed at non-critical times (at the gate, for example) rather 
than during critical times such as second 8 * 9 ment climb. Most 
often mentioned was the ability to program for SIDs at **je gate, 
relieving the pilot of certain steps immediately after takeoff. 
Most often mentioned was the MUSEL-4 departure from Santa Ana 
(see Figure 4), which was a complex procedure, further complicated 
by a mandatory noise abatement power reduction at 1000 feet. 

It is important to note once again that human factors 
engineers who have studied workload for years have not agreed on 
a definition, let alone a measurement, of workload. The author 
has side-stepped this question by simply defining workload as 
whatever the person doing the work says it is. Thus, whiae some 
of the comments and criticisms voiced by the crew may seem minor 
to the outsider '.for example the number of turns necessary to set 
the radio altimeter minimums) , they unquestionably affect the 
crews' perception of workload, and should not be ignored. The 
pilot who told the author that his workload had been increased 
because there was no place to put his pencil in the -80 must be 
taken seriously. (He stuck it between the glare shield and the 
bulkhead on traditional models. ) 

6. On the closely related issue of time for extra-cockpit 
scanning, pilots were almost unanimous in reporting that the 
!u?™«icn .nd cockpit configuration of the -80 did not allow any 
additional time "to have your head out of the cockpit. Most 
attributed this to the increasing scanning or monitoring demand 
imposed by automation. This is a disappointing, though important 
finding, in view of the fact that flightdeck automation has been 
sold as a means of allowing crews to spend more time with ® x “a- 
cockpit scanning, especially important for short and medium haul 
carriers whose crews spend a relatively large amount of their 
time in crowded terminal areas. Obviously the designers ®n 
operators Sill have to address this problem, as the forecast is 
for increases in terminal area traffic for the remainder of this 
century. If the results of this study are correct, advanced 
cockpit technology has not offered any relief. 

7. in qeneral, cockpit automation was not viewed, even by its 
strongest supporters, as a boon to safety. Their attitude toward 
the safety aspect of automation was essentially neutral. Most 
crew members viewed positively the fuel savings and workload 
redistribution properties of automation, and many simply praised 
the modernity of the -80 compared to earlier DC-9s, and many 
described it as a "neat" airplane to fly, but they saw no safety 
advantage to the automatic features* 

8. This study did not provide a good test of questions .relating 
to possible loss of proficiency due to over-reliance on 
automation. This was due primarily to the fact, already 
described, that during most of the study period, crews were 
flying mixed blocks of *80 and traditional DC-9 tinker so we i 
not obtain good data on exclusive or nearly exclusive usage of 
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. : __ Yf ta interesting to note that most of the crews 

iio^sUrionceri oier pHsiS?^ loss of proficiency, particularly 
oJio? to Republic's acquisition of the -80 simulator, when they 
P j anti-irate taking a proficiency check in a -10 or 30 

Simulator. 'bK none aaw thi. as a « r *° u ? w»s 

worked out his own "training program of hand flying, whicn was 
seen as the means of avoiding any proficiency loss. Each had his 
own plan, which he stuck to religiously, almost as if it were a 
regulation. The author called these personal FARs. L®* 1 

reported that their programs had prevented any problem, and that 
they had encountered no difficulties in tneir proficiency checks. 

The potential for proficiency loss in crews flying highly 
automated aircraft has been noted by airlines £J d *^ ody 

aircraft, especially in long overseas flights, and that the 
nJobltm cannot be easily dismissed. This question is wortny of 
KSh It rts^cS? and should be examined further in crews that 
are exclusively flying modern, highly automated aircraft. It is 
commendable that each crew member developed his personal FAR* 
but^the matter of skills maintenance may be too important to be 
left to each crew member's subjective judgement. 

During the study, numerous -80 pilots bid back to 
traditional models of the DC-9. In Minneapolis, many had 
relatively little time in the -80, for reasons mentioned 
previously. But prior to the closing of the Las Vegas base, 

^ n A r _ on niiots with considctdblc time bid back to 
?^?t?Lal models? ill “potted that the -backward transition- 

io p“ile^ iid ti« within the first trip they weieflyinq 
as well as ever. Some commented that their experience in the -80 
“d iide ihii iioother pilots of traditional DC-9s after their 
backward transition. 

q The lack of a simulator during the first year and a half of 
operation of the -80 clearly hindered transition and training. 

Most crew members reported difficulty during their initial line 
experience. The duration reported varied considerably, but mos 
f ?». t hat the first 100-200 hours were difficult. Some reported 
durations 1 as 50 hours to "be comfortable" with the 

?Ughi guidance systems. There was a clear difference between 
the 9 Las 9 Vegas crews who had taken their initial braining in t:he 
-80 simulator program and the other pilots in the y , th t 
respect to their perception of the time required to feel that 

they had mastered the -80. 

One problem that was probably underestimated in . 

transition training was the Simb 

0 f the DC-9. The higher power, and greater rates or cumu 

Ascent of the -80, had not been taken into account in the 
ITa ,g prior to the -80 simulator. Much of the difficulty that 

the i /ice -80 pilots encountered in operating the flight 
qu ida..ce C sy stem^may have due in part to the ^her pe.fora.nce of 
the aircraft. Many expressed surprise that they were behind 
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feelings of not being ‘co»fo"table!“ h les ' and their 

unqu.et ionebly^a^de^in^'traneition^arrt 6 st « u ‘‘ ^eenent 

and maintenance, it is not within the £ r .? flCI f ncy ac< luisition 
comment on 1 loor-management aarlfJLf? S f ope of this study to 
exception, as it ^ directly addre«2 t 8 ' but thia c «e is in 
issues that were central to this I?!dv * 5ff riety ? f h ™ a n factors 
co iments of the Las Vegas pilotl, Sh?!. I ?*? clear frora the 
tc be impacted by the separate statSs fhf«- ?° le Were the firs t 
considerably smoother by their abilitv to** 1 tran f ition was made 
the initial period of exposure fc fly onl y the -60 durinq 

contrast with the Minneapolis pilots ShO !S?f kpit * This is in 
before acquiring 100 hours of i.nfrfi fcooften went months 
was strongly reinforced ^ ?h. the -*>• This view 

author, both in Las Vegas*.,,!! MiSSSSpSiil?" lntervi «“* d by the 

This is not to $av that nr*— o i 
were as experienced as those at Re^h?^' especiall y those who 
and traditional models at the sarae P tiif c, cannot safety fly -80s 
transition time to the "comfortable- ifv*V * ^ Xs clear than 
probably total traininq time InH if a. 1 ® f 1 18 Creased, and 
reduced by a separate status. r ainly check airman costs are 

11# Durinq Wave One. nrir»r *•« 

classroom training and the use of thf qU f S ^ ion of the simulator, 
transition to the -80 uas qenfrfflJ fg 8ta 5 1C air P lan * for 
problem probably arises frlm the lack f? 38 inade< 2uate. The 
devices. The classroom pJesentft^ °£ Ff° per instructional 
center in Long Beach and at Republic's Douglas’ training 

Minneapolis relied on audio-visual fsl * f ? rence ! cl asses in 
presentation, and a static voodenmifJ^ plus audi0 ta P e) 
guidance control panel Th*co !t n ™ ockup of the -80 flight 
training for skill acquisition ilTmfff are far from °Ptimal for 
the flight guidance system and auto-throttle fj 8 !'®" 1 a f dynan >ic as 
80. Nor is an elaborate, expensive ? ystem of the DC-9- 

appropriate tool for initial P fami i < hole “ task simulator the 
programming skills. What is oo"i£J!iJ Z f£i2 n ,, a " d ac< J uia ition of 

pUo^CL^i" 8 WhiCh “* S «P d b?e^f° f 
the aircraft systems and the conseqJenles^ of ‘hu^tft!!" 108 

a h P f oa* br ”° nb r a ining^ r0 it a is e i n ef£icient^t COCkP ^ t re< 3 uires a new 

W ^°^ e “task simulator for trainina^rA 6 ^ t0 use an ex P e nsive 
skiils. it is ineffective to do 9 it J?[J® lng . and cognitive 
loop) devices. The time is ripe to deieinf r ’ lnteractlve <open- 
traming techniques. The decreasina fffJ °P new, cost-effective 
make such developments feasible and thfJ ° f com P uter hardware 
achieved with presently available off can P robabl y be 
cost and the challenge, however, re°mf 
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methods and training software. It is a significant comment on 
training that the crews repeatedly told the author that whenever 
the slightest unexpected event occurred, such as a change of 
runway, they would "click it off." 

12. Continuing attention must be directed toward basic human 
factors in the design of cockpits. The movement toward computer- 
based, new technology cockpits has made traditional human 
factors more important, not less. Programming errors, or what 
Wiener and Curry <1980) called "set-up" errors, remain a wjak 
link in system management. Automated flight systems appear to 
have the discomforting property of tuning out minor errors while 
making gross errors more likely (Wiener, 19fa5). While there iy a 
lively discussion within the systems professions about the 
potential for new information technologies such as artificial 
intelligence to solve such problems, these techniques are 
undeveloped and unproven. At best, their introduction into the 
commercial cockpit may be years away. In the meantime, designers 
must pay careful attention to traoitional problems, such as 
control design, keyboard entry devices, warning and alerting 
systems, and ever, such seemingly mundane matters as cockpit 
lighting. The effective employment of new technology on the 
flightdeck still depends to a large extent not on exotica, but on 
time-honored human factors principles. 

13. This study has found no signs of automation-induced psycho- 
social problems such as negativity toward the flying as an 
occupation, or loss of self-esteem. It would appear that this is 
simply not a matter worthy of concern, and until early signs of 
such a problem appear in the future, further research into 
psycho-social areas does not appear to be justified. If any 
psycho-social effect was detected in the -80 pilots, it was a 
sense of pride in having the opportunity to fiy a modern 
transport aircraft. 
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Appendix 1 

Automation Principles from wiener and Curry il 980 ) 


Tasks 


iK2&22:* tla " ind n ° £ 

2. Design the automatic system to perform the task th® Ui .„ *.w 

“f« « Bt * 11 (consistent »ith P oth.r constats such as 

safety); this may require user control of certain oaralitSri 
such as system qains (see Princiole No si y..„ ^ rameters, 

automated systems find t5at “Xe glteSi di^noS^rf^thJ 
function in the manner desired by the operator For av . m i 
autopilots, especially older desiqns have too , ! niJh r » eXaBple ' . 
for passenger lomfor/vhen tracki^grullnd based nav^«fon’ 99le 
stations. Thus, many airline pilots do not use this fe«*-ure 
even when travelling coast-to-coast on non-stop flights' 

3. Design the automation to prevent peak levels of task HsmnnH 

o~ratorr n La; CeSSiV V this “» ^ ftoi o^ra tit le 

necessary * activity Ti* 0 '^' 9 “ 1101 cnly a l«9iti«ate, but a 
riecessary activity of tne human operator; however, it aenpr*iiv 


4. For most complex systems, it is very difficult for the 
computer to sense when the task demands on the XperaXor are too 
high. Thus the operator must be trained and SotiJJSed t! 
automation as an additional resource (i.e. as X helper)? 

f* ? 6 fi r ! £ an ? needs f ° l automation will vary with oDerator- 

;T f ° r ! ny one °P «»tor. Allow *5? dif feren^operato 
styles" (choice of automation) when feasible. lirerent opcrato 

?' nf?? Ure that overail system performance will be insensitive 

ys ot tracK ground-based navigation stations. 

to set - u P a " d information inpu 

«nrt will A fc ® y8t s * Many autom atic system failures have been 
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8. Extensive training is required for operators vorking with 
automated equipment, not only to ensure proper operation and set- 
up, but to impart a knowledge of correct operation (for anomaly 
detection) and malfunction procedures (for diagnosis and 
treatment). * 


Monitoring Tasks 


9. Operators should be trained, motivated, and evaluated to 
monitor effectively. 


1°. If automation reduces task demands to low levels, provide 
meaningful duties to maintain operator involvement and resistance 
to distraction. Many others have recommended adding tasks# bt f 
it is extremely important that any additional duties be 

meaningful (not "make-work") and directed toward the primary task 
itself* 2 


J K * e P. fal f e . alar ® cates within acceptable limits (recognize 
the behavioral impact of excessive false alarms). 


12. Alarms with more than one mode, or more than one condition 
that can trigger the alarm for a mode, must clearly indicate 
which condition is responsible for the alarm display. 

13. When response time is not critical, most operators will 
attempt to check the validity of the alarm. Provide information 
in a proper format for that this validity check can be made 
quickly and accurately and not become a source of distraction. 
Also provide the operator with information and controic to 
diagnose the automatic system and warning system operation. Some 
of these should be easy, quick checks of sensors and indicators 
(such as the familiar "press to test" for light bulbs), larger 
systems may require logic tests. 


14. The format of the alarm should indicate the degree of 

emergency. Multiple levels of urgency of the same condition may 
be beneficial. 


D ey ise training techniques and possible training hardware 
(including part- and whole-task simulators) to ensure that 
flight-crews are exposed to all forms of alerts and to many or the 
possible conditions of alerts, and that they understand how to 
deal with them. 
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Appendix 2 

Data Management 

(This section by Ron Reisman) 

Jhr* 8 decided earl * in this project to do most of the 
d J! ^ a ? ag ? men 3 t ?* k8 on the A PP le il + microcomputer, but 
software 6 (sp?iT S in ® f . thxs d *ta with sophisticated statistical 
the t uSiJ*rfi?S > «? m? isrge mainframe computer (UNIVAC 1100) at 
the University of Miami. Thu- we had to 1) assemble a versatile 

In iDn^? P ^ e 2 »T a ?*" ent infor ” 4C1 °" system that would “S ot 
an an ?, 2 * Revise a communications system so that the data 

could be easily accessed by relevant software packages on both 
micro- and mainframe computers. v y Dotn 

_ , ?B Master# a commercial data base management program, was 
selected as the basis of the Apple's information sy«SJ“ tSJ 
questionnaires were entered into two DB Master 
files. One file contained the Likert data# the other file 
th ® J ercen t-Use data. Both files contained the 
flying time information about the individual pilots# alonq with 

f j eldS f ° r m i sce ii ane ous noLtion;. A lomp^ete 
2 f ^ rep ? rt f ?F raats were composed so that all data could be 
future^ ° Ut edSlly * New re P° rt formats can be defined in the 

uK . , Master uses a proprietary disk operating system (DOS) 
which is incompatible with the standard Apple disk operatina 
system. A utility program# DB Master Utility Pak #lf i^used to 
transfer the data from the DB Master files (Shich use Jhe 

Thif 1 ! 4 ?'! system) to disks using the standard Apple DOS 3.3. 
This utility translates the data from a DB Master format into a 
Data Interchange Format (DIF) which can be read by almost 100 
other commercially available programs. Data which are stored in 
be sent to a variety of spread sheet# statistics# 
graphics or word processing packages. This provides the Apple- 
based management information system with considerable 
versatility# since a wide variety of packaged programs can be 
SHteJ? manipulate the data w hich was oiiginally entered into DB 

In ord ® r to use the powerful, mainframe statistical analysis 
packages, the data had to be reformatted from the DIF files into 
n £ ;;: '* ad by SPSS. A special program was written 

nc« t f?i App i e whl 5 h creates SPSS-comj atibl e Likert and Percent- 
Use files from the DIF files and stores them on DOS 3.3 disks 

ove^teleDhon!* 1 ? < f lles are then transmitted to the UNIVAC 1100 
over telephone lines# using a modem (D.C. Hayes Micro-modem II) 
and communications software (Visiterm) . 
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Appendix 3 

Glossary of DC-9- 80 terms and abbreviations 




i er " 8 apply *° £he DC" 9 " 80 systems. This glossary 
S? fhl A I! d ? COnunon aviat ion terms and abbreviations. Many 

? £ fc ?f . te 5 r ? 8 ,‘? el0 Y are more £ull y defined in a glossary in the y 
Republic Airlines' publication DC- 9- 80 pjff er ^nri> B Training . 


ABS - Autobrake System 

ALFA Speed - minimum safe maneuvering speed for a given 
configuration 

\ - ARTS - Automatic Reserve Thrust System 

ATS (also A/T) - Autothrottle System 
CADC - Central Air Data Computer 
CAWS - Central Aural Warning System 

CLAMP ("CLMP" ) - a mode displayed on the FMA when electrical 

power is removed from the autothrottle servos 
on takeoff roll 

Dial-a-Flap - a takeoff flap selector which allows the crew 
to select other than fixed detent positions 

DFGC - Digital Flight Guidance Computer 

DFGS - Digital Flight Guidance System 

FMA - Flight Mode Annunciator (see Figure 6) 

".'ARP - acronym for Thrust-Armed-Roll-Pitch, the four mode windows 
^heFMA itself* 1 * t6rm 18 son,etin,es used b y pilots to mean 

TCI - Thrust Computer Indicator (sometimes called TRI - Thrust 
Rating Indicator) 



Appendix 4 

DC- 9- 80 AUTOMATIC FLIGHT SYSTEMS 

The following material is from the Republic Airlines 
Doug las D C- 9- 80 Pilot 1 a Handbook . It is included for the benefit 
of the reader who may not be familiar with automatic flight, and 
is not intended to be a comprehensive description of the systems. 


General 


The airplane is equipped with a flight guidance system (FGS) for 
flight guidance throughout the entire flight envelope (takeoff to 
landing). Two digital flight guidance computers (DFGC 1 and 2) 
provide data input for the FGS functions. 


Autopilot 

The AP function, operating in conjunction with the yaw damper 
function, automatically controls the airplane in pitch, roll, and 
yaw maneuvering axes. Appropriate control surfaces are actuated 
by the AP to control the airplane for the selected mode of 
operation. 


The AP modes of operation will automatically control the 
airplane pitch and roll attitude for the following maneuvers: 
maintain an existing altitude; descend or climb to and maintain a 
preselected heading, fly to, capture, and track a selected VOR or 
localizer course; capture and track a glideslope. 


Autothrottle/Speed control 


The autothrottle/speed control functions are available for 
operation from takeoff to landing. Aerodynamic sensors, airplane 
surface transducers, CADC's, and other sources provide input to 
the DFGC s for cpeed control processing. 


Seven throttle operational modes are available for selection on 
the FGCP and thrust rating indicator, or occur automatically. 

s P ee< * m °des are as follows: Indicated airspeed select 

(SPD SEL); Mach select (MACH SEL;; and EPR limit for takeoff (TO) 
takeoff flexible (TO PLX) , go-around (GA), maximum continuous 
thrust (MCT), climb (CL), and cruise (CR). 


Appropriate annunciations including numerical values (when 
applicable) appear on the FMA (see Figure 6 of this report) to 
lrdicate existing operating mode of the autothrottle/speed 
contro^. K 


it * 
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The autothrottle function automatically positions the throttles 
to maintain airspeed or engine thrust as require for the 
operational mode selected and airplane control surface 
configuration. The autothrottle function will control the 
throttles for the following maneuvers: Takeoff, climb, cruise, 

holding, approach, flare, and go -around. 


Altitude Advisory System 

The altitude advisory system automatically alerts the Captain and 
First Officer that the airplane is approaching the preselected 
altitude or that the airplane is deviating from a previously 
selected and acquired altitude. An advisory light on each 
altimeter provides the alert for either of the above situations. 


Autobrake 

When set, the automatic brake system (ABS) will automatically 
apply brakes during landing and takeoff modes of flight. The ABS 
landing mode is armed prior to landing after landing gear is 
extended. 
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Intercorrelation matrices of attitude (Likert scale) data 
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